00000001:02000400:2.0F:1790945294.149894:0:2947:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1790945310.185067:0:3169:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1790945312.039226:0:3231:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 537 MB/s 00000001:01000000:0.0F:1790945312.294976:0:3231:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 799 MB/s 00000001:01000000:2.0:1790945312.545672:0:3231:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6427 MB/s 00000020:02000000:3.0:1790945313.282693:0:3260:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_2_gbfaf0e7 00000400:02000000:2.0:1790945314.171924:0:3275:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.148@tcp [8/256/0/180] 00008000:02000000:3.0:1790945317.634818:0:3425:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1790945366.140422:0:5232:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790945376.792591:0:5804:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790945376.792598:0:5804:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790945376.792980:0:5804:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000111ae807 00000080:02000400:2.0:1790945376.792991:0:5804:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:2.0:1790945376.803720:0:5804:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1790945376.803747:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790945376.803820:0:5804:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000048b63468) 00000020:00000080:2.0:1790945376.803840:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0F:1790945376.829118:0:5804:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1790945376.832632:0:5804:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1790945376.921431:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790945376.921480:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790945376.921502:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790945376.921564:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790945376.921593:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790945376.922543:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790945376.922563:0:5804:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790945376.922574:0:5804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a54eead 00000020:01000004:2.0:1790945376.922837:0:5804:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790945376.922842:0:5804:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790945376.922848:0:5804:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000111ae807 from MGS 00000020:01000004:2.0:1790945376.922852:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790945376.922862:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ccbb1ae1) 00000020:00000080:2.0:1790945376.922872:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790945376.922990:0:5804:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000111ae807 from MGS, refs=2 00080000:01000000:2.0:1790945376.923001:0:5804:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790945376.923006:0:5804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a54eebb 00000100:00100000:3.0:1790945376.928423:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790945376.929005:0:5804:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790945376.929012:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790945376.930016:0:5804:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790945376.930024:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790945376.930819:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945376.930999:0:5804:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790945376.931004:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790945376.933295:0:5804:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1790945376.933306:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790945376.940244:0:5804:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790945376.940263:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1790945376.955563:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945376.955580:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945376.955582:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945376.959073:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945376.959081:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945376.959084:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945376.962915:0:5804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1790945376.967987:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1790945377.223700:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2126 MB/s 00000001:01000000:3.0:1790945377.473802:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6491 MB/s 00000001:01000000:1.0:1790945377.724631:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 899 MB/s 00000001:01000000:2.0:1790945377.973927:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 915 MB/s 00080000:10000000:2.0:1790945377.979366:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1790945377.988783:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790945377.988801:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790945377.988803:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1790945377.989386:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790945377.989450:0:5804:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790945377.989487:0:5804:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1790945377.989651:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1790945377.989717:0:5804:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790945377.990029:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790945377.990178:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790945377.990185:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790945377.994726:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790945377.994741:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790945377.995256:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790945377.995264:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790945377.995884:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1790945377.995906:0:5804:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.148@tcp' 00000020:01000004:0.0:1790945377.995908:0:5804:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1790945377.996028:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.148@tcp (typ=mgc) 00000020:00000080:0.0:1790945377.996047:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.148@tcp (00000000f211107d) 00000020:00000080:0.0:1790945377.996064:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1790945377.996182:0:5804:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000063ac1eab@MGC192.168.202.148@tcp: add connection 192.168.202.148@tcp at head 00010000:00010000:0.0:1790945377.996344:0:5804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.148@tcp-0 is initialized 00000040:01000000:0.0:1790945377.996351:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 1 is initialized 10000000:01000000:0.0:1790945377.996560:0:5820:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1790945377.996585:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.148@tcp (uuid bd8d2e96-ca7b-43e8-9882-d7f8a73e9618) 00000020:00000080:0.0:1790945377.996599:0:5804:0:(genops.c:1384:class_connect()) connect: client bd8d2e96-ca7b-43e8-9882-d7f8a73e9618, cookie 0xc5cf2c2a6a54eec9 00000100:00080000:0.0:1790945377.996608:0:5804:0:(import.c:545:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790945377.996614:0:5804:0:(import.c:666:import_select_connection()) MGC192.168.202.148@tcp: import 0000000063ac1eab using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1790945377.996684:0:5804:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005f090027 x1877942273572992/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790945377.996716:0:5804:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bd8d2e96-ca7b-43e8-9882-d7f8a73e9618->MGS 00000020:01000004:0.0:1790945377.996732:0:5804:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790945377.996736:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790945377.996745:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000cff7cab9) 00000020:00000080:0.0:1790945377.996754:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1790945378.000081:0:5819:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1790945378.000180:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f090027 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3291:1877942273572992:0@lo:250: 00000100:00100000:2.0:1790945378.000272:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945378.000361:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273572992 00000100:00100000:2.0:1790945378.000369:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273572992 00000100:00100000:2.0:1790945378.000398:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945378.000404:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f85412d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3291:x1877942273572992:12345-0@lo:250: 00010000:00080000:2.0:1790945378.000429:0:5815:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from bd8d2e96-ca7b-43e8-9882-d7f8a73e9618@0@lo t0 exp 0000000000000000 cur 123 last 0 00000020:00000080:2.0:1790945378.000455:0:5815:0:(genops.c:1384:class_connect()) connect: client bd8d2e96-ca7b-43e8-9882-d7f8a73e9618, cookie 0xc5cf2c2a6a54eed7 00000100:00080000:2.0:1790945378.000595:0:5815:0:(import.c:65:import_set_state_nolock()) 00000000bb4768ed : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945378.000646:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f85412d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+5:3291:x1877942273572992:12345-0@lo:250: Request processed in 241us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945378.000678:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945378.000721:0:3291:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790945378.000728:0:3291:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.148@tcp: connect to target with instance 0 00000100:00080000:2.0:1790945378.000735:0:3291:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790945378.000739:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790945378.000749:0:3291:0:(import.c:65:import_set_state_nolock()) 0000000063ac1eab MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790945378.000751:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790945378.000754:0:3291:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790945378.000758:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f090027 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3291:1877942273572992:0@lo:250: 00000100:00100000:0.0:1790945378.010111:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945378.010312:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1790945378.010319:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00010000:00010000:2.0:1790945378.014857:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945378.022294:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790945378.022306:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790945378.023566:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790945378.023575:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790945378.024528:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945378.024920:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790945378.024926:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790945378.027387:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790945378.027402:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790945378.053814:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945378.053997:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790945378.054003:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790945378.055100:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790945378.055116:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790945378.055860:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945378.056055:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790945378.056060:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1790945378.056506:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790945378.056512:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790945378.057238:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945378.057374:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790945378.057379:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1790945378.057914:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790945378.057921:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790945378.058510:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945378.058849:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790945378.058859:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1790945378.059273:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790945378.059280:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790945378.079302:0:5804:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790945378.079867:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790945378.079874:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1790945378.081292:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790945378.081303:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790945378.082563:0:5804:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790945378.082574:0:5804:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1790945378.083318:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1790945378.083339:0:5804:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1790945378.083346:0:5804:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1790945378.083474:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790945378.083514:0:5804:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.148@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1790945378.083518:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790945378.083520:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790945378.083521:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945378.083522:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945378.083523:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945378.083525:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945378.083526:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790945378.083528:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790945378.083529:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790945378.083531:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790945378.083532:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945378.083533:0:5804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790945378.083536:0:5804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1790945378.083538:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790945378.083550:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790945378.083551:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945378.083553:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945378.083554:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945378.083555:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945378.083556:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790945378.083562:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790945378.083563:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790945378.083564:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790945378.083565:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945378.083566:0:5804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790945378.083600:0:5804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790945378.083947:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000038cfe741 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573120:0@lo:253: 00000100:00100000:1.0:1790945378.084021:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945378.084120:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000baa71c8d going to sleep for 11 seconds 00000100:00100000:0.0:1790945378.084208:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273573120 00000100:00100000:0.0:1790945378.084215:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273573120 00000100:00100000:0.0:1790945378.084290:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790945378.084298:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000124e6c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+5:5804:x1877942273573120:12345-0@lo:253: 20000000:01000000:0.0:1790945378.084344:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790945378.084347:0:5818:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1790945378.084760:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790945378.084858:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1790945378.085123:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945378.086026:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1790945378.086232:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790945378.086236:0:5818:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1790945378.086242:0:5818:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1790945378.086244:0:5818:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1790945378.086258:0:5818:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1790945378.086437:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790945378.086782:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1790945378.086796:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790945378.086856:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1790945378.086905:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1790945378.086944:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1790945378.087033:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1790945378.087042:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1790945378.087086:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1790945378.087093:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1790945378.087124:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1790945378.087131:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1790945378.087160:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1790945378.087206:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1790945378.087237:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1790945378.087241:0:5818:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1790945378.087268:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790945378.087456:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1790945378.087466:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790945378.087499:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1790945378.087535:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1790945378.088178:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1790945378.088195:0:5818:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1790945378.088291:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1790945378.088300:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790945378.088345:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1790945378.088383:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1790945378.088419:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1790945378.088431:0:5818:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1790945378.088523:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1790945378.088532:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1790945378.088578:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1790945378.088611:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1790945378.088960:0:5818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1790945378.089012:0:5818:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1790945378.089019:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1790945378.089420:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1790945378.089823:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1790945378.089845:0:5818:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.148@tcp for mdt 20000000:01000000:0.0:1790945378.089847:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.148@tcp (null) (null) (null) 00000040:00080000:0.0:1790945378.089884:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1790945378.089893:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790945378.089924:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1790945378.089931:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.148@tcp (null) (null) 00000040:00080000:0.0:1790945378.089991:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1790945378.090003:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1790945378.090038:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1790945378.090073:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1790945378.090141:0:5818:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790945378.090145:0:5818:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790945378.090151:0:5818:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1790945378.090157:0:5818:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1790945378.090629:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1790945378.090824:0:5818:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1790945378.097320:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1790945378.097368:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1790945378.097438:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1790945378.097457:0:5818:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790945378.097459:0:5818:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790945378.097463:0:5818:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790945378.097475:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790945378.097477:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790945378.097504:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790945378.097506:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790945378.098103:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1790945378.098319:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1790945378.098347:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1790945378.098381:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1790945378.098393:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790945378.098395:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790945378.098929:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1790945378.099095:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1790945378.099117:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1790945378.099149:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1790945378.099158:0:5818:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790945378.099160:0:5818:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1790945378.099165:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790945378.099180:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54eede lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.099194:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54eede lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.099200:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54eede lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.099204:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54eede lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.099208:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54eede lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.099211:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54eede lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.099222:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003353d3b2 already unused, calling callback (00000000a6e61bdc) 00010000:00010000:1.0:1790945378.099224:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54eede lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.099229:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54eede lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.099239:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54eede lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.099245:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54eede lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.099249:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54eede lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790945378.099264:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790945378.288479:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000124e6c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+5:5804:x1877942273573120:12345-0@lo:253: Request processed in 204175us (204451us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945378.288499:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790945378.288860:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000038cfe741 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573120:0@lo:253: 10000000:01000000:0.0:1790945378.288878:0:5804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790945378.288881:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790945378.288883:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790945378.288884:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945378.288885:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1790945378.288886:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945378.288888:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945378.288889:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790945378.288890:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790945378.288907:0:5804:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790945378.288908:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945378.288909:0:5804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790945378.288926:0:5804:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000111ae807 from lustre-MDT0000 10000000:01000000:0.0:1790945378.288953:0:5804:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1790945378.288955:0:5804:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790945378.288959:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bb8656099c0 10000000:01000000:0.0:1790945378.288963:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790945378.288970:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bb8656099c0 from 1 10000000:01000000:0.0:1790945378.288973:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790945378.289008:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: 00000000bf942db2/0xc5cf2c2a6a54eee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.289018:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: 00000000bf942db2/0xc5cf2c2a6a54eee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.289027:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: 00000000bf942db2/0xc5cf2c2a6a54eee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945378.289043:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573248:0@lo:101: 00000100:00100000:0.0:1790945378.289080:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945378.289174:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e964f1f going to sleep for 11 seconds 00000100:00100000:2.0:1790945378.289276:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273573248 00000100:00100000:2.0:1790945378.289284:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273573248 00000100:00100000:2.0:1790945378.289423:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945378.289432:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006a3c9f15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+5:5804:x1877942273573248:12345-0@lo:101: 00010000:00010000:2.0:1790945378.289445:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945378.289459:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d27d319a/0xc5cf2c2a6a54eeec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54eee5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.289480:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d27d319a/0xc5cf2c2a6a54eeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54eee5 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.289489:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d27d319a/0xc5cf2c2a6a54eeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54eee5 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.289496:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d27d319a, rc 0) 00000100:00100000:2.0:1790945378.289599:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006a3c9f15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+6:5804:x1877942273573248:12345-0@lo:101: Request processed in 168us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945378.289605:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790945378.289814:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573248:0@lo:101: 00010000:00010000:0.0:1790945378.289828:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: 00000000bf942db2/0xc5cf2c2a6a54eee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54eeec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.289836:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: 00000000bf942db2/0xc5cf2c2a6a54eee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54eeec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945378.289877:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573376:0@lo:501: 00000100:00100000:0.0:1790945378.289903:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945378.289978:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e964f1f going to sleep for 11 seconds 00000100:00100000:2.0:1790945378.290079:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273573376 00000100:00100000:2.0:1790945378.290084:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273573376 00000100:00100000:2.0:1790945378.290352:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945378.290359:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fb079217 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+6:5804:x1877942273573376:12345-0@lo:501: 00000100:00100000:2.0:1790945378.290573:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fb079217 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+6:5804:x1877942273573376:12345-0@lo:501: Request processed in 214us (669us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790945378.290580:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790945378.290747:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573376:0@lo:501: 10000000:01000000:0.0:1790945378.290772:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790945378.290786:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: 00000000bf942db2/0xc5cf2c2a6a54eee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54eeec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.290793:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: 00000000bf942db2/0xc5cf2c2a6a54eee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54eeec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945378.290801:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bb845514800 10000000:01000000:0.0:1790945378.290805:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790945378.290809:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bb845514800 10000000:01000000:0.0:1790945378.290811:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790945378.290814:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bb845514800 from 1 10000000:01000000:0.0:1790945378.290816:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790945378.290831:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: 0000000055ceb079/0xc5cf2c2a6a54eef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.290838:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: 0000000055ceb079/0xc5cf2c2a6a54eef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.290845:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: 0000000055ceb079/0xc5cf2c2a6a54eef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945378.290856:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573504:0@lo:101: 00000100:00100000:0.0:1790945378.290881:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945378.291106:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e964f1f going to sleep for 11 seconds 00000100:00100000:2.0:1790945378.291166:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273573504 00000100:00100000:2.0:1790945378.291170:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273573504 00000100:00100000:2.0:1790945378.291189:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790945378.291195:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c7c5b294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+6:5804:x1877942273573504:12345-0@lo:101: 00010000:00010000:2.0:1790945378.291202:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945378.291212:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000361e664d/0xc5cf2c2a6a54eefa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54eef3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.291227:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000361e664d/0xc5cf2c2a6a54eefa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54eef3 expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.291234:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000361e664d/0xc5cf2c2a6a54eefa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54eef3 expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.291240:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000361e664d, rc 0) 00000100:00100000:2.0:1790945378.291277:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c7c5b294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+7:5804:x1877942273573504:12345-0@lo:101: Request processed in 83us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945378.291284:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790945378.291365:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573504:0@lo:101: 00010000:00010000:0.0:1790945378.291377:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: 0000000055ceb079/0xc5cf2c2a6a54eef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.291392:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: 0000000055ceb079/0xc5cf2c2a6a54eef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945378.291404:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790945378.291418:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: 0000000055ceb079/0xc5cf2c2a6a54eef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.291425:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: 0000000055ceb079/0xc5cf2c2a6a54eef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945378.291431:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790945378.291435:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790945378.291438:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bb845514800 10000000:01000000:0.0:1790945378.291440:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790945378.291443:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1790945378.291444:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790945378.291456:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: 00000000afe28e06/0xc5cf2c2a6a54ef01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.291462:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: 00000000afe28e06/0xc5cf2c2a6a54ef01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.291467:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: 00000000afe28e06/0xc5cf2c2a6a54ef01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945378.291478:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573632:0@lo:101: 00000100:00100000:0.0:1790945378.291500:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945378.291512:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e964f1f going to sleep for 11 seconds 00000100:00100000:2.0:1790945378.291705:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273573632 00000100:00100000:2.0:1790945378.291709:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273573632 00000100:00100000:2.0:1790945378.291738:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790945378.291743:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000011333746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+7:5804:x1877942273573632:12345-0@lo:101: 00010000:00010000:2.0:1790945378.291750:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945378.291756:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e403eeb2/0xc5cf2c2a6a54ef08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54ef01 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.291778:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e403eeb2/0xc5cf2c2a6a54ef08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef01 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.291784:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e403eeb2/0xc5cf2c2a6a54ef08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef01 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.291789:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e403eeb2, rc 0) 00000100:00100000:2.0:1790945378.291823:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000011333746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+8:5804:x1877942273573632:12345-0@lo:101: Request processed in 79us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945378.291829:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790945378.292005:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573632:0@lo:101: 00010000:00010000:0.0:1790945378.292015:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: 00000000afe28e06/0xc5cf2c2a6a54ef01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54ef08 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.292022:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: 00000000afe28e06/0xc5cf2c2a6a54ef01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54ef08 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945378.292060:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573760:0@lo:501: 00000100:00100000:0.0:1790945378.292085:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945378.292114:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e964f1f going to sleep for 11 seconds 00000100:00100000:2.0:1790945378.292165:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273573760 00000100:00100000:2.0:1790945378.292170:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273573760 00000100:00100000:2.0:1790945378.292185:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790945378.292189:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc21138 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+8:5804:x1877942273573760:12345-0@lo:501: 00000100:00100000:2.0:1790945378.292508:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc21138 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:5804:x1877942273573760:12345-0@lo:501: Request processed in 318us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945378.292514:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790945378.292873:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573760:0@lo:501: 00000100:00100000:0.0:1790945378.292904:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573888:0@lo:503: 00000100:00100000:0.0:1790945378.292943:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945378.293009:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e964f1f going to sleep for 11 seconds 00000100:00100000:3.0:1790945378.293071:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273573888 00000100:00100000:3.0:1790945378.293076:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273573888 00000100:00100000:2.0:1790945378.293132:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790945378.293139:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000795d8517 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:5804:x1877942273573888:12345-0@lo:503: 00000100:00100000:2.0:1790945378.293331:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000795d8517 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:5804:x1877942273573888:12345-0@lo:503: Request processed in 193us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945378.293339:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790945378.293560:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273573888:0@lo:503: 00000100:00100000:2.0:1790945378.294232:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006c9c9c5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5847:1877942273574016:0@lo:502: 00000100:00100000:2.0:1790945378.294270:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945378.294333:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039ee9ec5 going to sleep for 11 seconds 00000100:00100000:0.0:1790945378.294434:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273574016 00000100:00100000:0.0:1790945378.294439:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273574016 00000100:00100000:0.0:1790945378.294508:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790945378.294515:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008c39b3d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:5847:x1877942273574016:12345-0@lo:502: 00000100:00100000:0.0:1790945378.294920:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008c39b3d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:5847:x1877942273574016:12345-0@lo:502: Request processed in 405us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945378.294927:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790945378.294999:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006c9c9c5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5847:1877942273574016:0@lo:502: 00000020:01000000:2.0:1790945378.295028:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945378.295038:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945378.295040:0:5847:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790945378.295045:0:5847:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1790945378.295048:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790945378.295060:0:5847:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005815dd35) 00000020:00000080:2.0:1790945378.295076:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1790945378.295081:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790945378.295150:0:5847:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790945378.295157:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a54ef16 00000020:00000080:2.0:1790945378.295357:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790945378.295362:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945378.295366:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945378.295367:0:5847:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790945378.295369:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945378.295373:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945378.295374:0:5847:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1790945378.295376:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790945378.295383:0:5847:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c834cce0) 00000020:00000080:2.0:1790945378.295391:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1790945378.295394:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790945378.295396:0:5847:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1790945378.295398:0:5847:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1790945378.295403:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790945378.295446:0:5847:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000111ae807 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1790945378.295463:0:5847:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000709e4b5e) 00000020:00000080:2.0:1790945378.295471:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1790945378.295532:0:5847:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790945378.295549:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5cf2c2a6a54ef2b 00000020:00000080:2.0:1790945378.295921:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1790945378.295928:0:5847:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790945378.295933:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc5cf2c2a6a54ef32 00080000:01000000:2.0:1790945378.295938:0:5847:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790945378.295949:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a54ef39 00080000:10000000:2.0:1790945378.296303:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1790945378.296498:0:5847:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1790945378.301939:0:5847:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1790945378.397272:0:5847:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1790945378.403091:0:5847:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1790945378.407216:0:5847:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1790945378.407509:0:5847:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790945378.485530:0:5847:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d7b46d97) 00000020:00000080:0.0:1790945378.485565:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1790945378.485638:0:5847:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790945378.485645:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a54ef47 00000020:00000080:2.0:1790945378.489478:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1790945378.490679:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790945378.549924:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790945378.626061:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790945378.663263:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790945378.704048:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790945378.729974:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1790945378.768001:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc5cf2c2a6a54ef4e 00000020:00000080:0.0:1790945378.768522:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790945378.768548:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945378.768556:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945378.768558:0:5847:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790945378.768561:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945378.768566:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945378.768568:0:5847:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790945378.768572:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790945378.768621:0:5847:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790945378.768638:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945378.768641:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945378.768642:0:5847:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1790945378.768655:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945378.768674:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945378.768675:0:5847:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790945378.768679:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790945378.768680:0:5847:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790945378.768910:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5847:1877942273574144:0@lo:502: 00000100:00100000:0.0:1790945378.768989:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945378.769135:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273574144 00000100:00100000:2.0:1790945378.769143:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273574144 00000100:00100000:2.0:1790945378.769181:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790945378.769189:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001f563a14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:5847:x1877942273574144:12345-0@lo:502: 00000100:00100000:2.0:1790945378.769482:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001f563a14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:5847:x1877942273574144:12345-0@lo:502: Request processed in 293us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945378.769490:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790945378.769568:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1409e10 going to sleep for 11 seconds 00000100:00100000:0.0:1790945378.769596:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5847:1877942273574144:0@lo:502: 00000020:01000000:0.0:1790945378.769618:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945378.769622:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945378.769624:0:5847:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790945378.769627:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1790945378.769806:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1790945378.769824:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790945378.769836:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: 00000000afe28e06/0xc5cf2c2a6a54ef01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54ef08 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.769846:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: 00000000afe28e06/0xc5cf2c2a6a54ef01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54ef08 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945378.769863:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bb845514800 from 1 10000000:01000000:0.0:1790945378.769865:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790945378.769888:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.769895:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.769903:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945378.769916:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273574272:0@lo:101: 00000100:00100000:0.0:1790945378.769944:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945378.770393:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273574272 00000100:00100000:1.0:1790945378.770401:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273574272 00000100:00100000:1.0:1790945378.770438:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790945378.770445:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000037dedcc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:5804:x1877942273574272:12345-0@lo:101: 00010000:00010000:1.0:1790945378.770456:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945378.770468:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54ef5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54ef55 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.770503:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54ef5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef55 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.770511:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54ef5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef55 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.770519:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003353d3b2, rc 0) 00000100:00100000:1.0:1790945378.770562:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000037dedcc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+10:5804:x1877942273574272:12345-0@lo:101: Request processed in 119us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945378.770569:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790945378.770929:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1409e10 going to sleep for 11 seconds 00000100:00100000:2.0:1790945378.770991:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4632d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273574272:0@lo:101: 00010000:00010000:2.0:1790945378.771006:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54ef5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.771014:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54ef5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945378.771529:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006c9c9c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273574400:0@lo:256: 00000100:00100000:2.0:1790945378.772145:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945378.772239:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000000dd4e58c going to sleep for 11 seconds 00000100:00100000:1.0:1790945378.772299:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273574400 00000100:00100000:1.0:1790945378.772306:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273574400 00000100:00100000:1.0:1790945378.772382:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790945378.772389:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007af8af9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+10:5804:x1877942273574400:12345-0@lo:256: 20000000:01000000:1.0:1790945378.772407:0:5817:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790945378.772413:0:5817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790945378.772573:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007af8af9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+10:5804:x1877942273574400:12345-0@lo:256: Request processed in 184us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945378.772588:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790945378.774066:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006c9c9c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273574400:0@lo:256: 10000000:01000000:0.0:1790945378.774707:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790945378.774732:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54ef5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.774744:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54ef5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945378.774754:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb845514800 from 1 10000000:01000000:0.0:1790945378.774757:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790945378.774792:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.774800:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.774819:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945378.774839:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000422ad7fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273574528:0@lo:101: 00000100:00100000:0.0:1790945378.774894:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945378.774929:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c9b714af going to sleep for 11 seconds 00000100:00100000:3.0:1790945378.775144:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273574528 00000100:00100000:3.0:1790945378.775151:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273574528 00000100:00100000:3.0:1790945378.775202:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790945378.775212:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001f212f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+10:5804:x1877942273574528:12345-0@lo:101: 00010000:00010000:3.0:1790945378.775225:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945378.775239:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005e624444/0xc5cf2c2a6a54ef6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54ef63 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.775259:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e624444/0xc5cf2c2a6a54ef6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef63 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.775267:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005e624444/0xc5cf2c2a6a54ef6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef63 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.775275:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005e624444, rc 0) 00000100:00100000:3.0:1790945378.775338:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001f212f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:5804:x1877942273574528:12345-0@lo:101: Request processed in 128us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945378.775345:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790945378.775794:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000422ad7fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273574528:0@lo:101: 00010000:00010000:0.0:1790945378.775811:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54ef6a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.775818:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54ef6a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945378.775864:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000422ad7fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273574656:0@lo:501: 00000100:00100000:0.0:1790945378.775892:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945378.775959:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c9b714af going to sleep for 11 seconds 00000100:00100000:1.0:1790945378.776122:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273574656 00000100:00100000:1.0:1790945378.776128:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273574656 00000100:00100000:2.0:1790945378.776223:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790945378.776231:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005fb5a1b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:5804:x1877942273574656:12345-0@lo:501: 00000100:00100000:2.0:1790945378.776832:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005fb5a1b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:5804:x1877942273574656:12345-0@lo:501: Request processed in 601us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945378.776839:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790945378.777014:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000422ad7fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273574656:0@lo:501: 00000100:00100000:1.0:1790945378.777051:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e73126af pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273574784:0@lo:503: 00000100:00100000:1.0:1790945378.777094:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945378.777126:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4c6fb51 going to sleep for 11 seconds 00000100:00100000:2.0:1790945378.777245:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273574784 00000100:00100000:2.0:1790945378.777250:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273574784 00000100:00100000:2.0:1790945378.777271:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790945378.777277:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000920d614 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:5804:x1877942273574784:12345-0@lo:503: 00000040:00080000:2.0:1790945378.777310:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790945378.777354:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000920d614 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:5804:x1877942273574784:12345-0@lo:503: Request processed in 77us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945378.777360:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790945378.777430:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e73126af pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273574784:0@lo:503: 00000040:00080000:1.0:1790945378.778443:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1790945378.778886:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1790945378.778904:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945378.778923:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54ef6a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.778934:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54ef6a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945378.778975:0:5804:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790945378.778977:0:5804:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bb845514800 10000000:01000000:2.0:1790945378.778979:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bb845514800 10000000:01000000:2.0:1790945378.778982:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790945378.778988:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bb845514800 from 1 10000000:01000000:2.0:1790945378.778990:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945378.779016:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: 00000000fa10fabc/0xc5cf2c2a6a54ef71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.779037:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: 00000000fa10fabc/0xc5cf2c2a6a54ef71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.779045:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: 00000000fa10fabc/0xc5cf2c2a6a54ef71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945378.779064:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d47b7326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273574912:0@lo:101: 00000100:00100000:2.0:1790945378.779111:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945378.779139:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f0da78af going to sleep for 11 seconds 00000100:00100000:1.0:1790945378.779185:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273574912 00000100:00100000:1.0:1790945378.779191:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273574912 00000100:00100000:1.0:1790945378.779234:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790945378.779241:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a22be79a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:5804:x1877942273574912:12345-0@lo:101: 00010000:00010000:1.0:1790945378.779253:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945378.779263:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091fd7cef/0xc5cf2c2a6a54ef78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54ef71 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.779282:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091fd7cef/0xc5cf2c2a6a54ef78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef71 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.779290:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091fd7cef/0xc5cf2c2a6a54ef78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef71 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.779297:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091fd7cef, rc 0) 00000100:00100000:1.0:1790945378.779330:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a22be79a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5804:x1877942273574912:12345-0@lo:101: Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945378.779337:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790945378.779441:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d47b7326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273574912:0@lo:101: 00010000:00010000:2.0:1790945378.779454:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: 00000000fa10fabc/0xc5cf2c2a6a54ef71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54ef78 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945378.779461:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: 00000000fa10fabc/0xc5cf2c2a6a54ef71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54ef78 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945378.779503:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d47b7326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273575040:0@lo:501: 00000100:00100000:2.0:1790945378.779529:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945378.779557:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f0da78af going to sleep for 11 seconds 00000100:00100000:1.0:1790945378.779602:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273575040 00000100:00100000:1.0:1790945378.779606:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273575040 00000100:00100000:1.0:1790945378.779632:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790945378.779638:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c8de8897 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5804:x1877942273575040:12345-0@lo:501: 00000100:00100000:1.0:1790945378.780199:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c8de8897 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5804:x1877942273575040:12345-0@lo:501: Request processed in 560us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945378.780207:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790945378.780271:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d47b7326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273575040:0@lo:501: 00000100:00100000:2.0:1790945378.780301:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d47b7326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273575168:0@lo:503: 00000100:00100000:2.0:1790945378.780337:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945378.780365:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f0da78af going to sleep for 11 seconds 00000100:00100000:0.0:1790945378.780407:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273575168 00000100:00100000:0.0:1790945378.780411:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273575168 00000100:00100000:0.0:1790945378.780442:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790945378.780448:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000777963a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5804:x1877942273575168:12345-0@lo:503: 00000100:00100000:0.0:1790945378.780965:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000777963a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5804:x1877942273575168:12345-0@lo:503: Request processed in 516us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945378.780972:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790945378.781057:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d47b7326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273575168:0@lo:503: 00000100:00100000:1.0:1790945378.783475:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e73126af pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5852:1877942273575296:0@lo:502: 00000100:00100000:1.0:1790945378.783563:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945378.783613:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 00000000155bc92d going to sleep for 11 seconds 00000100:00100000:3.0:1790945378.783818:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273575296 00000100:00100000:3.0:1790945378.783827:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273575296 00000100:00100000:2.0:1790945378.783937:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790945378.783952:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000db6a575b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5852:x1877942273575296:12345-0@lo:502: 00000100:00100000:2.0:1790945378.784244:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000db6a575b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5852:x1877942273575296:12345-0@lo:502: Request processed in 293us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945378.784253:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790945378.784876:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e73126af pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5852:1877942273575296:0@lo:502: 00000020:01000004:3.0:1790945378.784946:0:5852:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790945378.784971:0:5852:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000daeadf57) 00000020:00000080:3.0:1790945378.784989:0:5852:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1790945378.785101:0:5852:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000111ae807 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790945378.785105:0:5852:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000111ae807 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790945378.785107:0:5852:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000111ae807 4 00010000:00080000:3.0:1790945378.785133:0:5852:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a406d9a5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:2.0:1790945378.790504:0:5852:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1790945378.790890:0:5852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790945378.790927:0:5852:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790945378.790938:0:5852:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc5cf2c2a6a54ef86 00000100:00080000:2.0:1790945378.790947:0:5852:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790945378.790957:0:5852:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a406d9a5 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1790945378.790990:0:5852:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d47b7326 x1877942273575424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790945378.791063:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d47b7326 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1877942273575424:0@lo:38: 00000100:00100000:3.0:1790945378.791137:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790945378.791209:0:5852:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790945378.791368:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273575424 00000100:00100000:0.0:1790945378.791375:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273575424 00000100:00100000:0.0:1790945378.791416:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790945378.791421:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002c261b8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1877942273575424:12345-0@lo:38: 00000100:00100000:0.0:1790945378.796529:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002c261b8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1877942273575424:12345-0@lo:38: Request processed in 5098us (5384us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790945378.796555:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945378.796953:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f3f6089 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5852:1877942273575552:0@lo:502: 00000100:00100000:2.0:1790945378.797020:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945378.797055:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037047647 going to sleep for 11 seconds 00000100:00100000:2.0:1790945378.797093:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790945378.797100:0:3291:0:(import.c:65:import_set_state_nolock()) 00000000a406d9a5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790945378.797104:0:3291:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790945378.797107:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d47b7326 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1877942273575424:0@lo:38: 00000100:00100000:3.0:1790945378.797250:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273575552 00000100:00100000:3.0:1790945378.797257:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273575552 00000100:00100000:3.0:1790945378.797297:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790945378.797304:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d81d1b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5852:x1877942273575552:12345-0@lo:502: 00000100:00100000:3.0:1790945378.797520:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d81d1b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5852:x1877942273575552:12345-0@lo:502: Request processed in 216us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945378.797527:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790945378.797636:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f3f6089 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5852:1877942273575552:0@lo:502: 00000040:00080000:2.0:1790945378.797680:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1790945378.797886:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1790945378.797902:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790945378.797945:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: 00000000fa10fabc/0xc5cf2c2a6a54ef71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54ef78 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.797956:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: 00000000fa10fabc/0xc5cf2c2a6a54ef71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54ef78 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790945378.798001:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790945378.798003:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790945378.798004:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945378.798005:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790945378.798007:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945378.798008:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945378.798009:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790945378.798011:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790945378.798012:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790945378.798013:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790945378.798014:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945378.798015:0:5804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790945378.798019:0:5804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1790945378.798021:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790945378.798022:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790945378.798023:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945378.798024:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790945378.798025:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945378.798026:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945378.798027:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790945378.798028:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790945378.798028:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790945378.798029:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790945378.798030:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945378.798031:0:5804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790945378.798045:0:5804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790945378.798053:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e34593b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273575680:0@lo:253: 00000100:00100000:3.0:1790945378.798082:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945378.798113:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ea3119f going to sleep for 11 seconds 00000100:00100000:2.0:1790945378.798218:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273575680 00000100:00100000:2.0:1790945378.798223:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273575680 00000100:00100000:2.0:1790945378.798254:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790945378.798260:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000038add5c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5804:x1877942273575680:12345-0@lo:253: 20000000:01000000:2.0:1790945378.798285:0:5817:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790945378.798296:0:5817:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790945378.839899:0:5817:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790945378.839920:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790945378.839964:0:5840:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790945378.839970:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790945378.839990:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.840009:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54ef5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef55 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.840032:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.840068:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54ef5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef55 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.840083:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54ef5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef55 expref: 12 pid: 5817 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945378.840097:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a665e70 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5840:1877942273575808:0@lo:104: 00000100:00100000:3.0:1790945378.840159:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945378.840219:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a7326863 going to sleep for 11 seconds 00000100:00100000:1.0:1790945378.840439:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273575808 00000100:00100000:1.0:1790945378.840448:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273575808 00000100:00100000:1.0:1790945378.840496:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790945378.840504:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000031e1bce1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5840:x1877942273575808:12345-0@lo:104: 00010000:00010000:1.0:1790945378.840515:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54ef5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945378.840595:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790945378.840601:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000031e1bce1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5840:x1877942273575808:12345-0@lo:104: Request processed in 98us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945378.840608:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790945378.840621:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a665e70 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5840:1877942273575808:0@lo:104: 00010000:00010000:3.0:1790945378.840637:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.840739:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945378.840745:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54ef5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.840752:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000083fe1377 already unused, calling callback (0000000085a17281) 10000000:00010000:0.0:1790945378.840755:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54ef5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.840763:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54ef5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945378.840769:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54ef5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945378.840774:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945378.840810:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54ef5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.840817:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945378.840841:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54ef5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.840847:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: 0000000083fe1377/0xc5cf2c2a6a54ef55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54ef5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945378.840862:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945378.840872:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945378.840873:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945378.840920:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945378.840930:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056efc052 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273575936:0@lo:103: 00000100:00100000:0.0:1790945378.840960:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945378.841483:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273575936 00000100:00100000:3.0:1790945378.841489:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273575936 00010000:00010000:3.0:1790945378.841507:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54ef5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef55 expref: 13 pid: 5817 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945378.841547:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790945378.841554:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004a5f8830 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:3292:x1877942273575936:12345-0@lo:103: 00010000:00010000:3.0:1790945378.841563:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945378.841567:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54ef5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef55 expref: 13 pid: 5817 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.841575:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54ef5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef55 expref: 13 pid: 5817 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.841595:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003353d3b2/0xc5cf2c2a6a54ef5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef55 expref: 13 pid: 5817 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.841607:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.841613:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790945378.841626:0:5808:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001657470s 00010000:00010000:3.0:1790945378.841629:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.841634:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.841639:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.841645:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.841650:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001c338461 already unused, calling callback (00000000a6e61bdc) 00010000:00010000:3.0:1790945378.841653:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.841692:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.841703:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.841733:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945378.841771:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004a5f8830 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:3292:x1877942273575936:12345-0@lo:103: Request processed in 217us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945378.841777:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790945378.841808:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056efc052 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273575936:0@lo:103: 00010000:00010000:3.0:1790945378.841836:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.841842:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945378.841848:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001c338461/0xc5cf2c2a6a54ef8d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945378.854067:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000038add5c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:5804:x1877942273575680:12345-0@lo:253: Request processed in 55800us (55977us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945378.854084:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790945378.854262:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e34593b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5804:1877942273575680:0@lo:253: 10000000:01000000:0.0:1790945378.854279:0:5804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790945378.854283:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790945378.854284:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790945378.854286:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945378.854287:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945378.854288:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945378.854290:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945378.854291:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790945378.854292:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790945378.854294:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790945378.854295:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790945378.854297:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945378.854298:0:5804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790945378.854312:0:5804:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790945378.862542:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1790945378.863000:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790945378.863208:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1790945378.863382:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790945378.864237:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1790945378.864430:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1790945378.866026:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1790945378.866197:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1790945378.867076:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1790945378.867886:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1790945378.868089:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1790945378.868429:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1790945378.948364:0:5804:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1790945378.990424:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1790945378.990557:0:5857:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1790945378.990561:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1790945378.994465:0:5858:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1790945378.998371:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790945379.002175:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790945379.002607:0:5804:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790945379.002619:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790945379.002823:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790945379.003795:0:5804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790945379.004359:0:5804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790945379.004386:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790945379.008499:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790945379.010614:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1790945379.012379:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1790945379.012557:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1790945379.012753:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1790945379.012916:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1790945379.013086:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1790945379.013242:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1790945379.013385:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1790945379.019640:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1790945379.021822:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1790945379.023975:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1790945379.025385:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1790945379.025563:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1790945379.029019:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1790945379.029237:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1790945379.029473:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1790945379.029684:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1790945379.031287:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1790945379.032135:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1790945379.032282:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1790945379.032460:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1790945379.032615:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1790945379.032802:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1790945379.032939:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1790945379.033099:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1790945379.033243:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1790945379.033385:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1790945379.033517:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1790945379.035953:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1790945379.036093:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1790945379.036604:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1790945379.037611:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1790945379.042971:0:5804:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1790945379.043266:0:5804:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1790945379.043729:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790945379.073116:0:5858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1790945379.175177:0:5804:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790945379.175214:0:5804:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6b441c6b988 00100000:10000000:1.0:1790945379.175222:0:5804:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1790945379.184208:0:5804:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790945379.184226:0:5804:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790945379.184238:0:5804:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1790945379.184263:0:5804:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1790945379.323896:0:5858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790945379.323982:0:5858:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1790945379.323987:0:5858:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1790945380.074459:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945381.084354:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945382.110916:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945383.132802:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945384.155975:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790945384.219910:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790945384.219921:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790945384.219924:0:38:0:(import.c:65:import_set_state_nolock()) 00000000a406d9a5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790945384.219941:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a406d9a5 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1790945384.219974:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d47b7326 x1877942273576192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790945384.220013:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d47b7326 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1877942273576192:0@lo:38: 00000100:00100000:2.0:1790945384.220091:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945384.220167:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273576192 00000100:00100000:2.0:1790945384.220175:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273576192 00000100:00100000:2.0:1790945384.220207:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945384.220213:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f6dc84fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3291:x1877942273576192:12345-0@lo:38: 00010000:00080000:2.0:1790945384.220239:0:5825:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 130 last 0 00000020:00000080:2.0:1790945384.220270:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc5cf2c2a6a54ef94 00000004:00100000:2.0:1790945384.220331:0:5825:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790945384.220447:0:5825:0:(import.c:65:import_set_state_nolock()) 000000009bfadd77 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945384.220506:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f6dc84fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1877942273576192:12345-0@lo:38: Request processed in 292us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945384.220514:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790945384.220553:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d47b7326 x1877942273576192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790945394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790945384.220566:0:3291:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790945384.220572:0:3291:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790945384.220575:0:3291:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790945384.220577:0:3291:0:(import.c:65:import_set_state_nolock()) 00000000a406d9a5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790945384.220582:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d47b7326 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1877942273576192:0@lo:38: 00000100:00100000:1.0:1790945384.220888:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f3f6089 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273576064:0@lo:400: 00000100:00100000:1.0:1790945384.220921:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945384.221008:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273576064 00000100:00100000:1.0:1790945384.221014:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273576064 00000100:00100000:1.0:1790945384.221041:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790945384.221047:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fa7beceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:3294:x1877942273576064:12345-0@lo:400: 00000100:00100000:1.0:1790945384.221082:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fa7beceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:3294:x1877942273576064:12345-0@lo:400: Request processed in 36us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945384.221088:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790945384.221118:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f3f6089 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273576064:0@lo:400: 10000000:01000000:2.0:1790945384.221762:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790945384.221766:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bb845514800 from 3 10000000:01000000:2.0:1790945384.221770:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790945384.221799:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: 0000000011e3c2c5/0xc5cf2c2a6a54ef9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945384.221809:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: 0000000011e3c2c5/0xc5cf2c2a6a54ef9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945384.221818:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: 0000000011e3c2c5/0xc5cf2c2a6a54ef9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945384.221833:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d47b7326 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273576320:0@lo:101: 00000100:00100000:2.0:1790945384.221862:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945384.221894:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fc2bd11 going to sleep for 11 seconds 00000100:00100000:3.0:1790945384.222020:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273576320 00000100:00100000:3.0:1790945384.222026:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273576320 00000100:00100000:3.0:1790945384.222056:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790945384.222062:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000405ecdaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:5820:x1877942273576320:12345-0@lo:101: 00010000:00010000:3.0:1790945384.222073:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945384.222084:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a2d194b8/0xc5cf2c2a6a54efa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54ef9b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945384.222102:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a2d194b8/0xc5cf2c2a6a54efa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef9b expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945384.222111:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a2d194b8/0xc5cf2c2a6a54efa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef9b expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945384.222119:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a2d194b8, rc 0) 00000100:00100000:3.0:1790945384.222151:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000405ecdaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5820:x1877942273576320:12345-0@lo:101: Request processed in 89us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945384.222167:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790945384.222215:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d47b7326 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273576320:0@lo:101: 00010000:00010000:3.0:1790945384.222229:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: 0000000011e3c2c5/0xc5cf2c2a6a54ef9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54efa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945384.222236:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: 0000000011e3c2c5/0xc5cf2c2a6a54ef9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54efa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945384.222275:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a665e70 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273576448:0@lo:256: 00000100:00100000:3.0:1790945384.222304:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945384.222316:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000809110c1 going to sleep for 11 seconds 00000100:00100000:3.0:1790945384.222326:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273576448 00000100:00100000:3.0:1790945384.222329:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273576448 00000100:00100000:3.0:1790945384.222350:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790945384.222354:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000007017903 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5820:x1877942273576448:12345-0@lo:256: 20000000:01000000:3.0:1790945384.222366:0:5815:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790945384.222380:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790945384.222383:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1790945384.222448:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000007017903 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5820:x1877942273576448:12345-0@lo:256: Request processed in 93us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945384.222456:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790945384.222495:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a665e70 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273576448:0@lo:256: 10000000:01000000:3.0:1790945384.222530:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790945384.222536:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: 0000000011e3c2c5/0xc5cf2c2a6a54ef9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54efa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945384.222543:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: 0000000011e3c2c5/0xc5cf2c2a6a54ef9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54efa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1790945384.678698:0:6100:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790945385.180006:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945386.206032:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945387.227936:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945388.252252:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945389.277544:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945389.340829:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f19ca75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273576576:0@lo:400: 00000100:00100000:2.0:1790945389.340912:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945389.341133:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000571176b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273576704:0@lo:400: 00000100:00100000:2.0:1790945389.341160:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945389.341191:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273576576 00000100:00100000:2.0:1790945389.341198:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273576576 00000100:00100000:2.0:1790945389.341239:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790945389.341246:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005e2e7da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:3295:x1877942273576576:12345-0@lo:400: 00000100:00100000:2.0:1790945389.341295:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005e2e7da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:3295:x1877942273576576:12345-0@lo:400: Request processed in 50us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945389.341302:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790945389.341653:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273576704 00000100:00100000:0.0:1790945389.341688:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273576704 00000100:00100000:0.0:1790945389.341717:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790945389.341723:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000dac88bd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273576704:12345-0@lo:400: 00000100:00100000:0.0:1790945389.341762:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000dac88bd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273576704:12345-0@lo:400: Request processed in 40us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945389.341769:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790945389.342780:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000571176b8 x1877942273576704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945389.342795:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000571176b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273576704:0@lo:400: 00000100:00100000:2.0:1790945389.342823:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f19ca75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273576576:0@lo:400: 00000020:00000080:1.0:1790945390.189595:0:6303:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd822346f0 20000000:00000080:1.0:1790945390.189964:0:6303:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb850e8a800 uarg=0000000000000000 20000000:01000000:1.0:1790945390.190003:0:6303:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790945390.190010:0:6303:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790945390.190015:0:6303:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790945390.190251:0:6303:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1790945390.190262:0:6303:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1790945390.195512:0:6303:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790945390.196164:0:6303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790945390.196224:0:6303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1790945390.196275:0:6303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1790945390.196292:0:6303:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790945390.196308:0:6303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945390.196326:0:6303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005e624444/0xc5cf2c2a6a54ef6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef63 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945390.196334:0:6303:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945390.196369:0:6303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005e624444/0xc5cf2c2a6a54ef6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef63 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945390.196383:0:6303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005e624444/0xc5cf2c2a6a54ef6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef63 expref: 11 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945390.196396:0:6303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006487d3f8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6303:1877942273576832:0@lo:104: 00000100:00100000:1.0:1790945390.196469:0:6303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945390.196925:0:6303:0:(client.c:2716:ptlrpc_set_wait()) set 00000000095f1087 going to sleep for 11 seconds 00000100:00100000:0.0:1790945390.196971:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273576832 00000100:00100000:0.0:1790945390.196980:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273576832 00000100:00100000:0.0:1790945390.197081:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790945390.197092:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000073de5067 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:6303:x1877942273576832:12345-0@lo:104: 00010000:00010000:0.0:1790945390.197106:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54ef6a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945390.197209:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790945390.197215:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000073de5067 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:6303:x1877942273576832:12345-0@lo:104: Request processed in 127us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945390.197222:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1790945390.197236:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945390.197242:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54ef6a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.197249:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000378e3b03 already unused, calling callback (0000000085a17281) 10000000:00010000:2.0:1790945390.197252:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54ef6a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.197260:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54ef6a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945390.197266:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54ef6a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945390.197280:0:6303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006487d3f8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6303:1877942273576832:0@lo:104: 10000000:01000000:2.0:1790945390.197283:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790945390.197297:0:6303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.197307:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54ef6a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.197313:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945390.197342:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54ef6a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.197350:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: 00000000378e3b03/0xc5cf2c2a6a54ef63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54ef6a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.197371:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945390.197372:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945390.197374:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945390.197596:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f19ca75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273576960:0@lo:103: 00000100:00100000:0.0:1790945390.197629:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945390.198018:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273576960 00000100:00100000:2.0:1790945390.198024:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273576960 00010000:00010000:2.0:1790945390.198048:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005e624444/0xc5cf2c2a6a54ef6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef63 expref: 12 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945390.198112:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945390.198119:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000803af01e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:3293:x1877942273576960:12345-0@lo:103: 00010000:00010000:2.0:1790945390.198131:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945390.198135:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005e624444/0xc5cf2c2a6a54ef6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef63 expref: 12 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.198144:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005e624444/0xc5cf2c2a6a54ef6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef63 expref: 12 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.198168:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005e624444/0xc5cf2c2a6a54ef6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef63 expref: 12 pid: 5815 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.198187:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.198195:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.198210:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.198217:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.198222:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.198228:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.198233:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006a475695 already unused, calling callback (00000000a6e61bdc) 00010000:00010000:2.0:1790945390.198237:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.198243:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.198263:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945390.198273:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945390.198310:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000803af01e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:3293:x1877942273576960:12345-0@lo:103: Request processed in 192us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945390.198325:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1790945390.198373:0:6303:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945390.198380:0:6303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945390.198386:0:6303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006a475695/0xc5cf2c2a6a54efa9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945390.200330:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f19ca75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273576960:0@lo:103: 00010000:00010000:0.0:1790945390.302161:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945391.332686:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945392.348129:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945393.372806:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790945393.437809:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790945393.437817:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb845514800 from 1 10000000:01000000:2.0:1790945393.437821:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790945393.437857:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: 0000000074959b7c/0xc5cf2c2a6a54efb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945393.437868:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: 0000000074959b7c/0xc5cf2c2a6a54efb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945393.437879:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: 0000000074959b7c/0xc5cf2c2a6a54efb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945393.437899:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000571176b8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273577088:0@lo:101: 00000100:00100000:2.0:1790945393.437957:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945393.438010:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 0000000073c02446 going to sleep for 11 seconds 00000100:00100000:1.0:1790945393.438146:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273577088 00000100:00100000:1.0:1790945393.438154:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273577088 00000100:00100000:1.0:1790945393.438203:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790945393.438211:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d63dc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:5820:x1877942273577088:12345-0@lo:101: 00010000:00010000:1.0:1790945393.438223:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945393.438235:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000025187325/0xc5cf2c2a6a54efb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54efb0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945393.438256:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000025187325/0xc5cf2c2a6a54efb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54efb0 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945393.438264:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000025187325/0xc5cf2c2a6a54efb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54efb0 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945393.438271:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000025187325, rc 0) 00000100:00100000:1.0:1790945393.438309:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d63dc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5820:x1877942273577088:12345-0@lo:101: Request processed in 99us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945393.438316:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790945393.438405:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000571176b8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273577088:0@lo:101: 00010000:00010000:2.0:1790945393.438419:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: 0000000074959b7c/0xc5cf2c2a6a54efb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54efb7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945393.438427:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: 0000000074959b7c/0xc5cf2c2a6a54efb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54efb7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945393.438474:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000571176b8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273577216:0@lo:501: 00000100:00100000:2.0:1790945393.438498:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945393.438511:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 0000000073c02446 going to sleep for 11 seconds 00000100:00100000:2.0:1790945393.438522:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273577216 00000100:00100000:2.0:1790945393.438525:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273577216 00000100:00100000:2.0:1790945393.438553:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790945393.438566:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000081b4cd7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5820:x1877942273577216:12345-0@lo:501: 00000100:00100000:2.0:1790945393.438799:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000081b4cd7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5820:x1877942273577216:12345-0@lo:501: Request processed in 232us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945393.438805:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790945393.438832:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000571176b8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273577216:0@lo:501: 00000100:00100000:2.0:1790945393.438854:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000571176b8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273577344:0@lo:503: 00000100:00100000:2.0:1790945393.438888:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945393.438899:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 0000000073c02446 going to sleep for 11 seconds 00000100:00100000:2.0:1790945393.438908:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273577344 00000100:00100000:2.0:1790945393.438911:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273577344 00000100:00100000:2.0:1790945393.438925:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790945393.438930:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000cbfd54f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5820:x1877942273577344:12345-0@lo:503: 00000100:00100000:2.0:1790945393.439515:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000cbfd54f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5820:x1877942273577344:12345-0@lo:503: Request processed in 584us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945393.439523:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790945393.446525:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000571176b8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273577344:0@lo:503: 00000100:00100000:2.0:1790945393.448074:0:6395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035413dad pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6395:1877942273577472:0@lo:502: 00000100:00100000:2.0:1790945393.448160:0:6395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945393.448208:0:6395:0:(client.c:2716:ptlrpc_set_wait()) set 00000000517bafb8 going to sleep for 11 seconds 00000100:00100000:0.0:1790945393.458120:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273577472 00000100:00100000:0.0:1790945393.458135:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273577472 00000100:00100000:0.0:1790945393.458218:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790945393.458226:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000946ce111 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6395:x1877942273577472:12345-0@lo:502: 00000100:00100000:0.0:1790945393.458453:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000946ce111 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6395:x1877942273577472:12345-0@lo:502: Request processed in 227us (10293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945393.458461:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790945393.458548:0:6395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035413dad pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6395:1877942273577472:0@lo:502: 00000020:01000000:3.0:1790945393.458580:0:6395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945393.458589:0:6395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945393.458591:0:6395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790945393.458598:0:6395:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb845514800 00000020:00000080:3.0:1790945393.458600:0:6395:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790945393.458680:0:6395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6395:1877942273577600:0@lo:502: 00000100:00100000:3.0:1790945393.458733:0:6395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945393.464975:0:6395:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb86c96be40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945393.465288:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273577600 00000100:00100000:2.0:1790945393.465298:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273577600 00000100:00100000:2.0:1790945393.465351:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790945393.465361:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6395:x1877942273577600:12345-0@lo:502: 00000100:00100000:2.0:1790945393.465590:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6395:x1877942273577600:12345-0@lo:502: Request processed in 230us (6856us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945393.465598:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790945393.467593:0:6395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6395:1877942273577600:0@lo:502: 00000020:01000000:3.0:1790945393.469139:0:6395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945393.469150:0:6395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945393.469153:0:6395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790945393.469157:0:6395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1790945393.469227:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790945393.469250:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790945393.469261:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a54efb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54efb7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945393.469273:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a54efb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54efb7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945394.403738:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945394.466549:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273577856:0@lo:400: 00000100:00100000:1.0:1790945394.466858:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273577728:0@lo:400: 00000100:00100000:1.0:1790945394.466908:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945394.467750:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945394.467766:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273577728 00000100:00100000:1.0:1790945394.467774:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273577728 00000100:00100000:2.0:1790945394.467786:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273577856 00000100:00100000:2.0:1790945394.467789:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273577856 00000100:00100000:2.0:1790945394.467815:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790945394.467815:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790945394.467822:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273577856:12345-0@lo:400: 00000100:00100000:1.0:1790945394.467822:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:3294:x1877942273577728:12345-0@lo:400: 00000100:00100000:2.0:1790945394.467869:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273577856:12345-0@lo:400: Request processed in 47us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945394.467869:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:3294:x1877942273577728:12345-0@lo:400: Request processed in 47us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945394.467877:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790945394.467877:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1790945394.467911:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bb87b5c3100 x1877942273577856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945394.467911:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273577728:0@lo:400: 00000100:00100000:2.0:1790945394.467923:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273577856:0@lo:400: 00010000:00010000:0.0:1790945395.422608:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945396.444790:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945397.470288:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790945398.130832:0:6668:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790945398.130836:0:6668:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1790945398.130970:0:6668:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bb8654d2800 00000020:01000004:3.0:1790945398.130985:0:6668:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790945398.130997:0:6668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1790945398.131014:0:6668:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bb865f83380) 00000020:00000080:3.0:1790945398.131029:0:6668:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790945398.196069:0:6668:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1790945398.196402:0:6668:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790945398.239428:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790945398.247292:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790945398.247329:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790945398.248850:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790945398.248883:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790945398.250294:0:6668:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790945398.250306:0:6668:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790945398.250318:0:6668:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc5cf2c2a6a54efc5 00000020:01000004:2.0:1790945398.250326:0:6668:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1790945398.250347:0:6668:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.148@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790945398.250364:0:6668:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790945398.250370:0:6668:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790945398.250375:0:6668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790945398.250387:0:6668:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bb87b5d4d40) 00000020:00000080:2.0:1790945398.250397:0:6668:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1790945398.256290:0:6668:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790945398.256485:0:6668:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790945398.256491:0:6668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790945398.264428:0:6668:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790945398.264443:0:6668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1790945398.265060:0:6668:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1790945398.265068:0:6668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1790945398.268455:0:6668:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790945398.268965:0:6668:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1790945398.268972:0:6668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1790945398.271770:0:6668:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1790945398.271779:0:6668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790945398.321082:0:6668:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790945398.324320:0:6668:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790945398.324329:0:6668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790945398.338340:0:6668:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790945398.338368:0:6668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790945398.340820:0:6668:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790945398.340832:0:6668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790945398.350428:0:6668:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790945398.351391:0:6668:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790945398.351398:0:6668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790945398.360038:0:6668:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1790945398.363445:0:6668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:0.0:1790945398.493871:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945398.498218:0:6668:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790945398.498419:0:6668:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790945398.498426:0:6668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790945398.502569:0:6668:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790945398.502594:0:6668:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790945398.503356:0:6668:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790945398.503380:0:6668:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1790945398.503385:0:6668:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1790945398.539907:0:6668:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790945398.540074:0:6668:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.148@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1790945398.540079:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790945398.540080:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790945398.540082:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945398.540083:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945398.540084:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945398.540085:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945398.540087:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790945398.540088:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790945398.540090:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790945398.540091:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945398.540092:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790945398.540096:0:6668:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1790945398.540098:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790945398.540326:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790945398.540327:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945398.540328:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945398.540329:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945398.540331:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945398.540332:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790945398.540333:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790945398.540333:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790945398.540335:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945398.540336:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790945398.540371:0:6668:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790945398.540390:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872feca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273577984:0@lo:253: 00000100:00100000:1.0:1790945398.540458:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.540790:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8654abf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945398.540852:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273577984 00000100:00100000:2.0:1790945398.540861:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273577984 00000100:00100000:2.0:1790945398.540915:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790945398.540925:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6668:x1877942273577984:12345-0@lo:253: 20000000:01000000:2.0:1790945398.541020:0:5818:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790945398.541024:0:5818:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1790945398.541029:0:5818:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1790945398.541033:0:5818:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1790945398.543561:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945398.544596:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1790945398.544614:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1790945398.544773:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1790945398.544782:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1790945398.544814:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1790945398.544869:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1790945398.545465:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1790945398.545486:0:5818:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.148@tcp 20000000:01000000:2.0:1790945398.545488:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.148@tcp (null) (null) (null) 00000040:00080000:2.0:1790945398.545534:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1790945398.545542:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790945398.545591:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1790945398.545608:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.148@tcp (null) (null) 00000040:00080000:2.0:1790945398.545645:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1790945398.546000:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1790945398.546042:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1790945398.546092:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1790945398.547071:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1790945398.547090:0:5818:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.148@tcp 20000000:01000000:2.0:1790945398.547092:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.148@tcp (null) (null) (null) 00000040:00080000:2.0:1790945398.547185:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1790945398.547194:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790945398.547226:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1790945398.547233:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.148@tcp (null) (null) 00000040:00080000:2.0:1790945398.547274:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1790945398.547284:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1790945398.547313:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1790945398.547344:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1790945398.547372:0:5818:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790945398.547376:0:5818:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790945398.547379:0:5818:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790945398.547391:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790945398.547393:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790945398.547422:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790945398.547424:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790945398.550635:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1790945398.557139:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1790945398.557190:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1790945398.557264:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1790945398.557279:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790945398.557281:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790945398.560893:0:6684:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1790945398.561003:0:6684:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1790945398.561055:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1790945398.561512:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1790945398.561550:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1790945398.561600:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1790945398.561612:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790945398.561620:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790945398.565491:0:6685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1790945398.565579:0:6685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1790945398.565637:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1790945398.566101:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1790945398.566275:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1790945398.566336:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1790945398.566364:0:5818:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1790945398.566367:0:5818:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1790945398.566375:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790945398.566394:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.566411:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54eeec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54eee5 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.566418:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54ef08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef01 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.566437:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54ef78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef71 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.566445:0:5818:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.566481:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54ef78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef71 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.566496:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54ef78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef71 expref: 12 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945398.566510:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877942273578112:0@lo:104: 00000100:00100000:3.0:1790945398.566569:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790945398.566687:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54ef08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef01 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.566695:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54ef08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef01 expref: 12 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945398.566703:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877942273578240:0@lo:104: 00000100:00100000:3.0:1790945398.566722:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790945398.574179:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54eeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54eee5 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.574197:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54eeec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54eee5 expref: 12 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945398.574212:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877942273578368:0@lo:104: 00000100:00100000:3.0:1790945398.574277:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945398.576446:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273578112 00000100:00100000:0.0:1790945398.576458:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273578112 00000100:00100000:0.0:1790945398.576505:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273578240 00000100:00100000:0.0:1790945398.576509:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273578240 00000100:00100000:0.0:1790945398.576522:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790945398.576530:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c933800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:5818:x1877942273578112:12345-0@lo:104: 00010000:00010000:0.0:1790945398.576545:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54ef71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54ef78 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945398.576617:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790945398.576634:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c933800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:5818:x1877942273578112:12345-0@lo:104: Request processed in 105us (10064us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945398.576641:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790945398.576675:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790945398.576682:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5818:x1877942273578240:12345-0@lo:104: 00010000:00010000:0.0:1790945398.576691:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54ef01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54ef08 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945398.576729:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790945398.576734:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5818:x1877942273578240:12345-0@lo:104: Request processed in 53us (10010us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945398.576739:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790945398.576859:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb845e00d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945398.576879:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877942273578112:0@lo:104: 00000100:00100000:3.0:1790945398.576887:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877942273578240:0@lo:104: 00010000:00010000:1.0:1790945398.576959:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790945398.576966:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54ef71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54ef78 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.576973:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1790945398.576976:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54ef71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54ef78 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.576984:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54ef71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54ef78 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945398.576990:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54ef71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54ef78 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945398.576995:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790945398.577029:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54ef71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54ef78 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577035:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945398.577051:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54ef71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54ef78 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577064:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54ef71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54ef78 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577075:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945398.577078:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54ef01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54ef08 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577084:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1790945398.577087:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54ef01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54ef08 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577093:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54ef01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54ef08 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945398.577098:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54ef01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54ef08 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945398.577103:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790945398.577125:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54ef01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54ef08 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577131:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945398.577136:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54ef01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54ef08 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577142:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54ef01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54ef08 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577153:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945398.577160:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945398.577162:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945398.577175:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273578496:0@lo:103: 00000100:00100000:1.0:1790945398.577210:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.577234:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945398.577239:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273578624:0@lo:103: 00000100:00100000:1.0:1790945398.577260:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.577301:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273578496 00000100:00100000:1.0:1790945398.577306:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273578496 00010000:00010000:1.0:1790945398.577325:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54ef78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef71 expref: 13 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945398.577355:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273578624 00000100:00100000:1.0:1790945398.577358:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273578624 00010000:00010000:1.0:1790945398.577369:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54ef08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef01 expref: 14 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945398.577382:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790945398.577387:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872feea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:3292:x1877942273578496:12345-0@lo:103: 00010000:00010000:1.0:1790945398.577396:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945398.577401:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54ef78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef71 expref: 14 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577410:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54ef78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef71 expref: 14 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577423:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54ef78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef71 expref: 14 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577434:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945398.577467:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872feea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:3292:x1877942273578496:12345-0@lo:103: Request processed in 80us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945398.577473:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790945398.577486:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790945398.577491:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:3292:x1877942273578624:12345-0@lo:103: 00010000:00010000:1.0:1790945398.577498:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945398.577502:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54ef08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef01 expref: 12 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577509:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54ef08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef01 expref: 12 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577517:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54ef08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef01 expref: 12 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577524:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945398.577544:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:3292:x1877942273578624:12345-0@lo:103: Request processed in 53us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945398.577549:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790945398.577576:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273578624:0@lo:103: 00000100:00100000:1.0:1790945398.577583:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273578496:0@lo:103: 00010000:00010000:1.0:1790945398.577763:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945398.577772:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273578368 00000100:00100000:1.0:1790945398.577776:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273578368 00000100:00100000:1.0:1790945398.577794:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790945398.577799:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5818:x1877942273578368:12345-0@lo:104: 00010000:00010000:1.0:1790945398.577808:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb840030000/0xc5cf2c2a6a54eee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54eeec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577852:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790945398.577857:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5818:x1877942273578368:12345-0@lo:104: Request processed in 58us (3581us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945398.577863:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1790945398.577876:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945398.577879:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb840030000/0xc5cf2c2a6a54eee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54eeec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577884:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030000 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1790945398.577887:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb840030000/0xc5cf2c2a6a54eee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54eeec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577893:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb840030000/0xc5cf2c2a6a54eee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54eeec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945398.577900:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb840030000/0xc5cf2c2a6a54eee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54eeec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945398.577904:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790945398.577917:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb840030000/0xc5cf2c2a6a54eee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54eeec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577922:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945398.577947:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb840030000/0xc5cf2c2a6a54eee5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54eeec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577954:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb840030000/0xc5cf2c2a6a54eee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54eeec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.577979:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945398.577980:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945398.577982:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945398.577991:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273578752:0@lo:103: 00000100:00100000:1.0:1790945398.578015:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.578041:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273578752 00000100:00100000:1.0:1790945398.578044:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273578752 00010000:00010000:1.0:1790945398.578055:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54eeec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54eee5 expref: 11 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945398.578072:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790945398.578077:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:3294:x1877942273578752:12345-0@lo:103: 00010000:00010000:1.0:1790945398.578084:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945398.578089:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54eeec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54eee5 expref: 11 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.578097:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54eeec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54eee5 expref: 11 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.578116:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.578125:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.578138:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.578145:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.578158:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.578165:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.578171:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8414a6c00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945398.578174:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.578181:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.578189:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.578198:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945398.578226:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:3294:x1877942273578752:12345-0@lo:103: Request processed in 148us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945398.578232:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790945398.578256:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273578752:0@lo:103: 00010000:00010000:3.0:1790945398.584935:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54eeec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54eee5 expref: 10 pid: 5817 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945398.584960:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1877942273578368:0@lo:104: 00010000:00010000:3.0:1790945398.584998:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.585009:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.585016:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.585023:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efd3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790945398.585039:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790945398.682059:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:6668:x1877942273577984:12345-0@lo:253: Request processed in 141125us (141590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945398.682074:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790945398.685984:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872feca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273577984:0@lo:253: 10000000:01000000:2.0:1790945398.686004:0:6668:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790945398.686007:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790945398.686008:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790945398.686009:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790945398.686010:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1790945398.686011:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790945398.686012:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790945398.686014:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790945398.686015:0:6668:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790945398.686017:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790945398.686018:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790945398.686043:0:6668:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bb8654d2800 from lustre-OST0000 10000000:01000000:2.0:1790945398.686070:0:6668:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790945398.686073:0:6668:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790945398.686080:0:6668:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bb8656099c0 local copy 10000000:01000000:2.0:1790945398.686084:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790945398.686131:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945398.686143:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945398.686153:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945398.686172:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273578880:0@lo:101: 00000100:00100000:2.0:1790945398.686228:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945398.686290:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48780 going to sleep for 11 seconds 00000100:00100000:1.0:1790945398.686396:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273578880 00000100:00100000:1.0:1790945398.686402:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273578880 00000100:00100000:1.0:1790945398.686450:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790945398.686460:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:6668:x1877942273578880:12345-0@lo:101: 00010000:00010000:1.0:1790945398.686481:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945398.686496:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54efe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54efda expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.686519:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54efe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54efda expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.686529:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54efe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54efda expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.686538:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167b400, rc 0) 00000100:00100000:1.0:1790945398.686591:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+10:6668:x1877942273578880:12345-0@lo:101: Request processed in 132us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945398.686598:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790945398.689860:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273578880:0@lo:101: 00010000:00010000:2.0:1790945398.689890:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc5cf2c2a6a54efe1 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945398.689903:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc5cf2c2a6a54efe1 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945398.690030:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579008:0@lo:501: 00000100:00100000:2.0:1790945398.690084:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945398.690139:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48780 going to sleep for 11 seconds 00000100:00100000:1.0:1790945398.690517:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273579008 00000100:00100000:1.0:1790945398.690536:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273579008 00000100:00100000:1.0:1790945398.690596:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790945398.690605:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+10:6668:x1877942273579008:12345-0@lo:501: 00000100:00100000:1.0:1790945398.690845:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+10:6668:x1877942273579008:12345-0@lo:501: Request processed in 240us (760us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790945398.690852:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790945398.690889:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579008:0@lo:501: 10000000:01000000:1.0:1790945398.690902:0:6668:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790945398.690927:0:6668:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790945398.690932:0:6668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc5cf2c2a6a54efe1 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.690940:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc5cf2c2a6a54efe1 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.690954:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc5cf2c2a6a54efe1 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.690971:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790945398.690989:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bb8654d2800 00010000:00010000:1.0:1790945398.690998:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945398.691003:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc5cf2c2a6a54efe1 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.691010:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5800 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1790945398.691013:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc5cf2c2a6a54efe1 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.691021:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc5cf2c2a6a54efe1 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945398.691027:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc5cf2c2a6a54efe1 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945398.691033:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790945398.691052:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc5cf2c2a6a54efe1 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.691056:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945398.691070:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc5cf2c2a6a54efe1 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.691076:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a54efda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc5cf2c2a6a54efe1 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.691100:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945398.691102:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945398.691103:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945398.691127:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273579136:0@lo:103: 00000100:00100000:1.0:1790945398.691156:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.691198:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273579136 00000100:00100000:1.0:1790945398.691202:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273579136 00000100:00100000:1.0:1790945398.691228:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790945398.691235:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+10:3295:x1877942273579136:12345-0@lo:103: 00010000:00010000:1.0:1790945398.691244:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945398.691258:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54efe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54efda expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.691271:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945398.691298:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:3295:x1877942273579136:12345-0@lo:103: Request processed in 64us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945398.691304:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790945398.691329:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273579136:0@lo:103: 10000000:01000000:1.0:1790945398.691354:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790945398.691360:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bb8656099c0 10000000:01000000:1.0:1790945398.691363:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790945398.691366:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9bb8656099c0 from 1 10000000:01000000:1.0:1790945398.691368:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790945398.691387:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167b200/0xc5cf2c2a6a54efe8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.691395:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb84167b200/0xc5cf2c2a6a54efe8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.691410:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb84167b200/0xc5cf2c2a6a54efe8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945398.691422:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579264:0@lo:101: 00000100:00100000:1.0:1790945398.691448:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.691461:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8654abf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945398.691596:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273579264 00000100:00100000:3.0:1790945398.691601:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273579264 00000100:00100000:3.0:1790945398.691633:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790945398.691640:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:6668:x1877942273579264:12345-0@lo:101: 00010000:00010000:3.0:1790945398.691650:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945398.691681:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efef lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54efe8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.691710:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54efe8 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.691719:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54efe8 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.691726:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8414a6c00, rc 0) 00000100:00100000:3.0:1790945398.691756:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+10:6668:x1877942273579264:12345-0@lo:101: Request processed in 117us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945398.691763:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790945398.692449:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579264:0@lo:101: 00010000:00010000:1.0:1790945398.692464:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb84167b200/0xc5cf2c2a6a54efe8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54efef expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.692474:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb84167b200/0xc5cf2c2a6a54efe8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54efef expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945398.692491:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790945398.692498:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167b200/0xc5cf2c2a6a54efe8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54efef expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.692507:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb84167b200/0xc5cf2c2a6a54efe8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54efef expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945398.692514:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790945398.692518:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790945398.692759:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1790945398.692763:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790945398.692783:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.692791:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.692807:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945398.692821:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579392:0@lo:101: 00000100:00100000:1.0:1790945398.692856:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.692924:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8654abf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945398.703634:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273579392 00000100:00100000:2.0:1790945398.703650:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273579392 00000100:00100000:2.0:1790945398.703731:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790945398.703741:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+10:6668:x1877942273579392:12345-0@lo:101: 00010000:00010000:2.0:1790945398.703758:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945398.703778:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8821c4800/0xc5cf2c2a6a54effd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54eff6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945398.703804:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c4800/0xc5cf2c2a6a54effd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54eff6 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945398.703816:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8821c4800/0xc5cf2c2a6a54effd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54eff6 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945398.703825:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4800, rc 0) 00000100:00100000:2.0:1790945398.703900:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:6668:x1877942273579392:12345-0@lo:101: Request processed in 160us (11042us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945398.703907:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790945398.708238:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579392:0@lo:101: 00010000:00010000:0.0:1790945398.708266:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54effd expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945398.708279:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54effd expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945398.708437:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579520:0@lo:501: 00000100:00100000:0.0:1790945398.708493:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945398.708887:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273579520 00000100:00100000:3.0:1790945398.708895:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273579520 00000100:00100000:3.0:1790945398.709000:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790945398.709010:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:6668:x1877942273579520:12345-0@lo:501: 00000100:00100000:3.0:1790945398.709259:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:6668:x1877942273579520:12345-0@lo:501: Request processed in 250us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945398.709267:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790945398.709726:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865fba900 going to sleep for 11 seconds 00000100:00100000:0.0:1790945398.709745:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579520:0@lo:501: 00000100:00100000:0.0:1790945398.709789:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579648:0@lo:503: 00000100:00100000:0.0:1790945398.709832:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945398.709866:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865fba900 going to sleep for 11 seconds 00000100:00100000:2.0:1790945398.709931:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273579648 00000100:00100000:2.0:1790945398.709942:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273579648 00000100:00100000:2.0:1790945398.709978:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790945398.709986:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:6668:x1877942273579648:12345-0@lo:503: 00000100:00100000:2.0:1790945398.710417:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:6668:x1877942273579648:12345-0@lo:503: Request processed in 432us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945398.710425:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790945398.710522:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579648:0@lo:503: 00000040:00080000:0.0:1790945398.710944:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790945398.711001:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579776:0@lo:502: 00000100:00100000:0.0:1790945398.711042:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945398.711063:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865fba900 going to sleep for 11 seconds 00000100:00100000:2.0:1790945398.711136:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273579776 00000100:00100000:2.0:1790945398.711141:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273579776 00000100:00100000:2.0:1790945398.711173:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790945398.711180:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:6668:x1877942273579776:12345-0@lo:502: 00000100:00100000:2.0:1790945398.711315:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:6668:x1877942273579776:12345-0@lo:502: Request processed in 135us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945398.711323:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790945398.711550:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579776:0@lo:502: 00000040:00080000:0.0:1790945398.712858:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790945398.712913:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790945398.712949:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790945398.713011:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790945398.713051:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790945398.713085:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790945398.713168:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579904:0@lo:502: 00000100:00100000:0.0:1790945398.713224:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.716774:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865fba900 going to sleep for 11 seconds 00000100:00100000:2.0:1790945398.720018:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273579904 00000100:00100000:2.0:1790945398.720034:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273579904 00000100:00100000:2.0:1790945398.720115:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790945398.720125:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:6668:x1877942273579904:12345-0@lo:502: 00000100:00100000:2.0:1790945398.720389:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:6668:x1877942273579904:12345-0@lo:502: Request processed in 265us (7164us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945398.720397:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790945398.720760:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273579904:0@lo:502: 00000040:00080000:1.0:1790945398.720900:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790945398.720917:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1790945398.722032:0:6686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790945398.722041:0:6686:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1790945398.722049:0:6686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945398.722051:0:6686:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790945398.722060:0:6686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790945398.722073:0:6686:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bb865f84d40) 00000020:00000080:3.0:1790945398.722094:0:6686:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790945398.722118:0:6686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790945398.722179:0:6686:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb8654d2800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790945398.722186:0:6686:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790945398.722192:0:6686:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc5cf2c2a6a54f00b 00010000:00010000:2.0:1790945398.730002:0:6686:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1790945398.730393:0:6686:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1790945398.734471:0:6686:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1790945398.734910:0:6686:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1790945398.746191:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1790945398.747056:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1790945398.748515:0:6686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1790945398.748534:0:6686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945398.748540:0:6686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945398.748542:0:6686:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1790945398.748545:0:6686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945398.748549:0:6686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945398.748550:0:6686:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790945398.748559:0:6686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790945398.748561:0:6686:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790945398.748603:0:6686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945398.748606:0:6686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945398.748607:0:6686:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790945398.748610:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1790945398.748794:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1790945398.748825:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790945398.748848:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54effd expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.748860:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54effd expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945398.748868:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb8654d2800 from 1 10000000:01000000:1.0:1790945398.748871:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790945398.748906:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.748913:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.748925:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945398.748959:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580032:0@lo:101: 00000100:00100000:1.0:1790945398.749023:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.749066:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8654abe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945398.751456:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273580032 00000100:00100000:2.0:1790945398.751468:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273580032 00000100:00100000:2.0:1790945398.751529:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790945398.751538:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:6668:x1877942273580032:12345-0@lo:101: 00010000:00010000:2.0:1790945398.751575:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945398.751593:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8821c5800/0xc5cf2c2a6a54f019 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f012 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945398.751619:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c5800/0xc5cf2c2a6a54f019 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f012 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945398.751630:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8821c5800/0xc5cf2c2a6a54f019 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f012 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945398.751639:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c5800, rc 0) 00000100:00100000:2.0:1790945398.751737:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6668:x1877942273580032:12345-0@lo:101: Request processed in 199us (2713us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945398.751744:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790945398.751857:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580032:0@lo:101: 00010000:00010000:1.0:1790945398.751875:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f019 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.751885:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f019 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945398.751981:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580160:0@lo:501: 00000100:00100000:1.0:1790945398.752014:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.752049:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8654abe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945398.752276:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273580160 00000100:00100000:2.0:1790945398.752281:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273580160 00000100:00100000:2.0:1790945398.752386:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790945398.752394:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6668:x1877942273580160:12345-0@lo:501: 00000100:00100000:2.0:1790945398.752607:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6668:x1877942273580160:12345-0@lo:501: Request processed in 213us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945398.752615:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790945398.754776:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580160:0@lo:501: 00000100:00100000:1.0:1790945398.754832:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580288:0@lo:503: 00000100:00100000:1.0:1790945398.754897:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.754935:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273580288 00000100:00100000:1.0:1790945398.754941:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273580288 00000100:00100000:1.0:1790945398.754974:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790945398.754982:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6668:x1877942273580288:12345-0@lo:503: 00000100:00100000:1.0:1790945398.755218:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6668:x1877942273580288:12345-0@lo:503: Request processed in 236us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945398.755226:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790945398.755275:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8654abe40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945398.755288:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580288:0@lo:503: 00000040:00080000:1.0:1790945398.755581:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790945398.755688:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580416:0@lo:502: 00000100:00100000:1.0:1790945398.755728:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.755752:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273580416 00000100:00100000:1.0:1790945398.755756:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273580416 00000100:00100000:1.0:1790945398.755775:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790945398.755781:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6668:x1877942273580416:12345-0@lo:502: 00000100:00100000:1.0:1790945398.755922:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6668:x1877942273580416:12345-0@lo:502: Request processed in 141us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945398.755929:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790945398.755958:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345a000 going to sleep for 11 seconds 00000100:00100000:1.0:1790945398.755972:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580416:0@lo:502: 00000040:00080000:1.0:1790945398.756217:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1790945398.756265:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1790945398.756288:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580544:0@lo:502: 00000100:00100000:1.0:1790945398.756321:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.759702:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273580544 00000100:00100000:1.0:1790945398.759715:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273580544 00000100:00100000:0.0:1790945398.759814:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790945398.759826:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6668:x1877942273580544:12345-0@lo:502: 00000100:00100000:0.0:1790945398.760073:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6668:x1877942273580544:12345-0@lo:502: Request processed in 249us (3750us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945398.760081:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790945398.760221:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345a000 going to sleep for 11 seconds 00000100:00100000:3.0:1790945398.760251:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580544:0@lo:502: 00000040:00080000:3.0:1790945398.760410:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790945398.760427:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790945398.763894:0:6690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945398.763907:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945398.763909:0:6690:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790945398.763916:0:6690:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb8654d2800 00000020:00000080:3.0:1790945398.763919:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790945398.763935:0:6690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945398.763937:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945398.763939:0:6690:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790945398.763942:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790945398.764074:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790945398.764101:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790945398.764153:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f019 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.764165:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f019 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945398.764205:0:6668:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790945398.764208:0:6668:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bb8654d2800 10000000:01000000:1.0:1790945398.764218:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bb8654d2800 10000000:01000000:1.0:1790945398.764222:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790945398.764227:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bb8654d2800 from 1 10000000:01000000:1.0:1790945398.764230:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790945398.764265:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.764274:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.764284:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945398.764307:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872feed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580672:0@lo:101: 00000100:00100000:1.0:1790945398.764380:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.764425:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345af00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945398.764472:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273580672 00000100:00100000:3.0:1790945398.764479:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273580672 00000100:00100000:3.0:1790945398.764520:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790945398.764540:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6668:x1877942273580672:12345-0@lo:101: 00010000:00010000:3.0:1790945398.764819:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945398.764833:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f020 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.764857:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f020 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.764866:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f020 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.764874:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8414a6800, rc 0) 00000100:00100000:3.0:1790945398.764920:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6668:x1877942273580672:12345-0@lo:101: Request processed in 392us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945398.764927:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790945398.765022:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872feed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580672:0@lo:101: 00010000:00010000:1.0:1790945398.765035:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f027 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.765043:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f027 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945398.765121:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872feed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580800:0@lo:501: 00000100:00100000:1.0:1790945398.765144:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.765168:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345af00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945398.765209:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273580800 00000100:00100000:2.0:1790945398.765214:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273580800 00000100:00100000:2.0:1790945398.765247:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790945398.765254:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6668:x1877942273580800:12345-0@lo:501: 00000100:00100000:2.0:1790945398.765465:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6668:x1877942273580800:12345-0@lo:501: Request processed in 211us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945398.765471:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790945398.765761:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872feed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580800:0@lo:501: 00000100:00100000:1.0:1790945398.765787:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872feed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580928:0@lo:503: 00000100:00100000:1.0:1790945398.765833:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.765854:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345af00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945398.765891:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273580928 00000100:00100000:3.0:1790945398.765896:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273580928 00000100:00100000:3.0:1790945398.765927:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790945398.765933:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6668:x1877942273580928:12345-0@lo:503: 00000100:00100000:3.0:1790945398.766073:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6668:x1877942273580928:12345-0@lo:503: Request processed in 139us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945398.766080:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790945398.766166:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872feed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273580928:0@lo:503: 00000040:00080000:1.0:1790945398.766421:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790945398.766479:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872feed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273581056:0@lo:502: 00000100:00100000:1.0:1790945398.766533:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.766718:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d480c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945398.766771:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273581056 00000100:00100000:3.0:1790945398.766775:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273581056 00000100:00100000:3.0:1790945398.766810:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790945398.766817:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6668:x1877942273581056:12345-0@lo:502: 00000100:00100000:3.0:1790945398.767053:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6668:x1877942273581056:12345-0@lo:502: Request processed in 236us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945398.767060:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790945398.767237:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872feed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273581056:0@lo:502: 00000040:00080000:3.0:1790945398.768133:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1790945398.768202:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1790945398.768241:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1790945398.768295:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1790945398.768336:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1790945398.768405:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1790945398.768445:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1790945398.768483:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1790945398.768977:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1790945398.769015:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1790945398.769048:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1790945398.769097:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1790945398.769134:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1790945398.769165:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1790945398.769230:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1790945398.769265:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1790945398.769307:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1790945398.769380:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1790945398.769417:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1790945398.769452:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1790945398.769499:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1790945398.769724:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1790945398.769764:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1790945398.769815:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1790945398.769849:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1790945398.769878:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1790945398.769923:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1790945398.769958:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1790945398.769998:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273581184:0@lo:502: 00000100:00100000:3.0:1790945398.770069:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945398.770172:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842bb1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790945398.770274:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273581184 00000100:00100000:2.0:1790945398.770283:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273581184 00000100:00100000:2.0:1790945398.770403:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790945398.770412:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6668:x1877942273581184:12345-0@lo:502: 00000100:00100000:2.0:1790945398.770993:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6668:x1877942273581184:12345-0@lo:502: Request processed in 581us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945398.771001:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790945398.771097:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273581184:0@lo:502: 00000040:00080000:3.0:1790945398.771179:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1790945398.771191:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1790945398.771925:0:6691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790945398.771940:0:6691:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bb865f80000) 00000020:00000080:3.0:1790945398.771958:0:6691:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1790945398.772041:0:6691:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb8654d2800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790945398.772046:0:6691:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb8654d2800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790945398.772048:0:6691:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bb8654d2800 3 00010000:00080000:3.0:1790945398.772075:0:6691:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb87fbcf000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.148@tcp at head 00010000:00010000:1.0:1790945398.774377:0:6691:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1790945398.774630:0:6691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1790945398.774697:0:6691:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790945398.774709:0:6691:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc5cf2c2a6a54f035 00000100:00080000:1.0:1790945398.774717:0:6691:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790945398.774728:0:6691:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bb87fbcf000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1790945398.774774:0:6691:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb872fef800 x1877942273581312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790945398.774803:0:6691:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1790945398.775019:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1790945398.775117:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1790945398.775139:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790945398.775154:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f027 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.775165:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f027 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790945398.775207:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790945398.775209:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790945398.775211:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945398.775216:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945398.775217:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945398.775218:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945398.775220:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790945398.775221:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790945398.775222:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790945398.775224:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945398.775225:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790945398.775229:0:6668:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1790945398.775231:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790945398.775232:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790945398.775233:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945398.775233:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945398.775234:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945398.775235:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945398.775236:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790945398.775237:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790945398.775238:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790945398.775238:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945398.775239:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790945398.775255:0:6668:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790945398.775269:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fefb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273581440:0@lo:253: 00000100:00100000:1.0:1790945398.775333:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.775375:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb86c86cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945398.775872:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273581440 00000100:00100000:3.0:1790945398.775879:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273581440 00000100:00100000:3.0:1790945398.775933:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790945398.775943:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6668:x1877942273581440:12345-0@lo:253: 20000000:01000000:3.0:1790945398.775970:0:5818:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790945398.775989:0:5818:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1790945398.776401:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790945398.776412:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273581568:0@lo:400: 00000100:00100000:3.0:1790945398.776456:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945398.776516:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273581568 00000100:00100000:3.0:1790945398.776521:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273581568 00000100:00100000:3.0:1790945398.776549:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790945398.776569:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273581568:12345-0@lo:400: 00000100:00100000:3.0:1790945398.776615:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273581568:12345-0@lo:400: Request processed in 47us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945398.776622:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790945398.776678:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bb86c931880 x1877942273581568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945398.776691:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273581568:0@lo:400: 00000100:00100000:2.0:1790945398.776834:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1877942273581312:0@lo:38: 00000100:00100000:2.0:1790945398.776868:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945398.781145:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273581312 00000100:00100000:3.0:1790945398.781159:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273581312 00000100:00100000:3.0:1790945398.781210:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790945398.781218:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1877942273581312:12345-0@lo:38: 00010000:00080000:3.0:1790945398.781245:0:5823:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:3.0:1790945398.781281:0:5823:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc5cf2c2a6a54f03c 00000004:00100000:3.0:1790945398.781300:0:5823:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790945398.781335:0:5823:0:(import.c:65:import_set_state_nolock()) ffff9bb87fbc9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790945398.781431:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1877942273581312:12345-0@lo:38: Request processed in 211us (4561us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945398.781437:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790945398.781485:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bb872fef800 x1877942273581312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790945408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945398.781516:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790945398.781525:0:3291:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1790945398.781531:0:3291:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790945398.781535:0:3291:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790945398.781538:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb87fbcf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790945398.781544:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1877942273581312:0@lo:38: 20000000:01000000:3.0:1790945398.838114:0:5818:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790945398.838128:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1790945398.838146:0:5840:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790945398.838150:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790945398.838169:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.838187:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54efa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54ef9b expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.838195:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.838232:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54efa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef9b expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.838247:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54efa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef9b expref: 13 pid: 5815 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945398.838260:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5840:1877942273581696:0@lo:104: 00000100:00100000:3.0:1790945398.838322:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945398.838380:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842bb16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945398.838627:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273581696 00000100:00100000:1.0:1790945398.838635:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273581696 00000100:00100000:1.0:1790945398.838695:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790945398.838704:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5840:x1877942273581696:12345-0@lo:104: 00010000:00010000:1.0:1790945398.838717:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54ef9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54efa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.838777:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790945398.838784:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5840:x1877942273581696:12345-0@lo:104: Request processed in 81us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945398.838792:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1790945398.838833:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945398.838839:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54ef9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54efa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.838847:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5000 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1790945398.838851:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54ef9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54efa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.838859:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54ef9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54efa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945398.838866:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54ef9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54efa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945398.838872:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790945398.838900:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54ef9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54efa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.838907:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945398.838923:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54ef9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54efa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.838931:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54ef9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54efa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.838948:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945398.838950:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945398.838951:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945398.838963:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945398.838972:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273581824:0@lo:103: 00000100:00100000:1.0:1790945398.839002:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945398.839032:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273581824 00000100:00100000:1.0:1790945398.839035:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273581824 00010000:00010000:1.0:1790945398.839050:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54efa2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef9b expref: 14 pid: 5815 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945398.839068:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790945398.839073:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb842ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:3292:x1877942273581824:12345-0@lo:103: 00010000:00010000:1.0:1790945398.839082:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945398.839086:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54efa2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef9b expref: 14 pid: 5815 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.839096:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54efa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef9b expref: 14 pid: 5815 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.839110:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.839117:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790945398.839128:0:5809:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001657470s 00010000:00010000:1.0:1790945398.839132:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.839139:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.839146:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.839153:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.839168:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8414a7c00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945398.839172:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.839180:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.839188:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945398.839198:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945398.839226:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb842ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:3292:x1877942273581824:12345-0@lo:103: Request processed in 152us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945398.839233:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790945398.839286:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273581824:0@lo:103: 00010000:00010000:3.0:1790945398.840089:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54efa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54ef9b expref: 13 pid: 5815 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945398.840110:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5840:1877942273581696:0@lo:104: 00010000:00010000:3.0:1790945398.840125:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.840134:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.840140:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945398.840146:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f043 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945398.851731:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:6668:x1877942273581440:12345-0@lo:253: Request processed in 75781us (76388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945398.851746:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790945398.851831:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fefb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6668:1877942273581440:0@lo:253: 10000000:01000000:1.0:1790945398.851846:0:6668:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790945398.851850:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790945398.851852:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790945398.851853:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945398.851854:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945398.851855:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945398.851856:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945398.851858:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790945398.851859:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790945398.851860:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790945398.851862:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945398.851864:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790945398.851878:0:6668:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790945398.857381:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1790945398.858160:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790945398.858394:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1790945398.858809:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790945398.859018:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1790945398.859408:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1790945398.860883:0:6668:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1790945399.097540:0:6668:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1790945399.097548:0:6668:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1790945399.097586:0:6668:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790945399.097639:0:6668:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790945399.097684:0:6668:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1790945399.097710:0:6668:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1790945399.515918:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945400.569081:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945401.569208:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790945401.630971:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790945401.630977:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bb845514800 from 21 10000000:01000000:2.0:1790945401.630981:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945401.631027:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945401.631037:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945401.631047:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945401.631069:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273581952:0@lo:101: 00000100:00100000:2.0:1790945401.631131:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945401.631186:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb877a120c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945401.631237:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273581952 00000100:00100000:0.0:1790945401.631245:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273581952 00000100:00100000:0.0:1790945401.631298:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790945401.631309:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5820:x1877942273581952:12345-0@lo:101: 00010000:00010000:0.0:1790945401.631331:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945401.631345:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb840030400/0xc5cf2c2a6a54f051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f04a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945401.631367:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb840030400/0xc5cf2c2a6a54f051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f04a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945401.631376:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb840030400/0xc5cf2c2a6a54f051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f04a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945401.631384:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030400, rc 0) 00000100:00100000:0.0:1790945401.631431:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:5820:x1877942273581952:12345-0@lo:101: Request processed in 115us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945401.631438:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790945401.631827:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273581952:0@lo:101: 00010000:00010000:2.0:1790945401.631842:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f051 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945401.631859:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f051 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945401.631910:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273582080:0@lo:501: 00000100:00100000:2.0:1790945401.631937:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945401.631965:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb877a120c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945401.632005:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273582080 00000100:00100000:0.0:1790945401.632009:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273582080 00000100:00100000:0.0:1790945401.632040:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790945401.632046:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:5820:x1877942273582080:12345-0@lo:501: 00000100:00100000:0.0:1790945401.632384:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:5820:x1877942273582080:12345-0@lo:501: Request processed in 337us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945401.632391:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790945401.632462:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273582080:0@lo:501: 00000100:00100000:1.0:1790945401.632494:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273582208:0@lo:503: 00000100:00100000:1.0:1790945401.632540:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945401.632826:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fee8240 going to sleep for 11 seconds 00000100:00100000:0.0:1790945401.632865:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273582208 00000100:00100000:0.0:1790945401.632870:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273582208 00000100:00100000:0.0:1790945401.632902:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790945401.632909:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:5820:x1877942273582208:12345-0@lo:503: 00000100:00100000:0.0:1790945401.633173:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:5820:x1877942273582208:12345-0@lo:503: Request processed in 263us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945401.633180:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790945401.633218:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273582208:0@lo:503: 00000100:00100000:0.0:1790945401.633397:0:6812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6812:1877942273582336:0@lo:502: 00000100:00100000:0.0:1790945401.633848:0:6812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945401.633909:0:6812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8434423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945401.637198:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273582336 00000100:00100000:2.0:1790945401.637215:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273582336 00000100:00100000:2.0:1790945401.637328:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790945401.637340:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6812:x1877942273582336:12345-0@lo:502: 00000100:00100000:2.0:1790945401.639008:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6812:x1877942273582336:12345-0@lo:502: Request processed in 1665us (5153us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945401.639020:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790945401.646387:0:6812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6812:1877942273582336:0@lo:502: 00000100:00100000:1.0:1790945401.646516:0:6812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6812:1877942273582464:0@lo:502: 00000100:00100000:1.0:1790945401.646608:0:6812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945401.646653:0:6812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fee8300 going to sleep for 11 seconds 00000100:00100000:0.0:1790945401.646912:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273582464 00000100:00100000:0.0:1790945401.646919:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273582464 00000100:00100000:0.0:1790945401.646967:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790945401.646976:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6812:x1877942273582464:12345-0@lo:502: 00000100:00100000:0.0:1790945401.647190:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:6812:x1877942273582464:12345-0@lo:502: Request processed in 215us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945401.647199:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790945401.648020:0:6812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6812:1877942273582464:0@lo:502: 00000040:00080000:1.0:1790945401.648053:0:6812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1790945401.648367:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1790945401.648413:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790945401.648437:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f051 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945401.648450:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f051 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945401.648459:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790945401.648461:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bb845514800 from 4 10000000:01000000:0.0:1790945401.648464:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790945401.648494:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945401.648510:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945401.648520:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945401.648536:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273582592:0@lo:101: 00000100:00100000:0.0:1790945401.648598:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945401.648632:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843442240 going to sleep for 11 seconds 00000100:00100000:1.0:1790945401.648815:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273582592 00000100:00100000:1.0:1790945401.648822:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273582592 00000100:00100000:1.0:1790945401.648860:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790945401.648867:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:5820:x1877942273582592:12345-0@lo:101: 00010000:00010000:1.0:1790945401.648877:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945401.648889:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb84167aa00/0xc5cf2c2a6a54f05f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f058 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945401.648908:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb84167aa00/0xc5cf2c2a6a54f05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f058 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945401.648922:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb84167aa00/0xc5cf2c2a6a54f05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f058 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945401.648930:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167aa00, rc 0) 00000100:00100000:1.0:1790945401.648966:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273582592:12345-0@lo:101: Request processed in 95us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945401.648972:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790945401.649279:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273582592:0@lo:101: 00010000:00010000:0.0:1790945401.649294:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f05f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945401.649301:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f05f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945401.649353:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273582720:0@lo:256: 00000100:00100000:0.0:1790945401.649385:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945401.649411:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843442240 going to sleep for 11 seconds 00000100:00100000:0.0:1790945401.649429:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273582720 00000100:00100000:0.0:1790945401.649432:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273582720 00000100:00100000:0.0:1790945401.649455:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790945401.649462:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273582720:12345-0@lo:256: 20000000:01000000:0.0:1790945401.649475:0:5815:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790945401.649491:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790945401.649504:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1790945401.650016:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273582720:12345-0@lo:256: Request processed in 553us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945401.650024:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790945401.650053:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273582720:0@lo:256: 10000000:01000000:0.0:1790945401.650085:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790945401.650090:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f05f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945401.650098:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f05f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945401.650105:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790945401.650107:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1790945401.650109:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790945401.650124:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945401.650131:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945401.650146:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945401.650158:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273582848:0@lo:101: 00000100:00100000:0.0:1790945401.650179:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945401.650206:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843442240 going to sleep for 11 seconds 00000100:00100000:1.0:1790945401.650243:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273582848 00000100:00100000:1.0:1790945401.650247:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273582848 00000100:00100000:1.0:1790945401.650275:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790945401.650281:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273582848:12345-0@lo:101: 00010000:00010000:1.0:1790945401.650289:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945401.650297:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f06d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f066 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945401.650312:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f066 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945401.650332:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f066 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945401.650339:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167ba00, rc 0) 00000100:00100000:1.0:1790945401.650369:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273582848:12345-0@lo:101: Request processed in 88us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945401.650375:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790945401.650490:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273582848:0@lo:101: 00010000:00010000:0.0:1790945401.650510:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f06d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945401.650518:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f06d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945401.650568:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273582976:0@lo:501: 00000100:00100000:0.0:1790945401.650591:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945401.650613:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843442240 going to sleep for 11 seconds 00000100:00100000:1.0:1790945401.650841:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273582976 00000100:00100000:1.0:1790945401.650845:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273582976 00000100:00100000:1.0:1790945401.650866:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790945401.650877:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273582976:12345-0@lo:501: 00000100:00100000:1.0:1790945401.651103:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273582976:12345-0@lo:501: Request processed in 225us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945401.651109:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790945401.651233:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273582976:0@lo:501: 00000100:00100000:0.0:1790945401.651258:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273583104:0@lo:503: 00000100:00100000:0.0:1790945401.651287:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945401.651311:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843442240 going to sleep for 11 seconds 00000100:00100000:0.0:1790945401.651333:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273583104 00000100:00100000:0.0:1790945401.651336:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273583104 00000100:00100000:0.0:1790945401.651360:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790945401.651365:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273583104:12345-0@lo:503: 00000100:00100000:0.0:1790945401.651922:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273583104:12345-0@lo:503: Request processed in 555us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945401.651933:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790945401.651991:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273583104:0@lo:503: 00000100:00100000:3.0:1790945401.652958:0:6813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6813:1877942273583232:0@lo:502: 00000100:00100000:3.0:1790945401.653005:0:6813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945401.653037:0:6813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb844cd2780 going to sleep for 11 seconds 00000100:00100000:2.0:1790945401.653078:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273583232 00000100:00100000:2.0:1790945401.653083:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273583232 00000100:00100000:2.0:1790945401.653117:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790945401.653123:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:6813:x1877942273583232:12345-0@lo:502: 00000100:00100000:2.0:1790945401.653391:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:6813:x1877942273583232:12345-0@lo:502: Request processed in 267us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945401.653397:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790945401.653802:0:6813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6813:1877942273583232:0@lo:502: 00000020:01000000:3.0:1790945401.653831:0:6813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790945401.653838:0:6813:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790945401.653845:0:6813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945401.653848:0:6813:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790945401.653852:0:6813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790945401.653856:0:6813:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:3.0:1790945401.653876:0:6813:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790945401.653879:0:6813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790945401.653902:0:6813:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bb865feb380) 00000020:00000080:3.0:1790945401.653921:0:6813:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1790945401.653928:0:6813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790945401.654014:0:6813:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790945401.654019:0:6813:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790945401.654026:0:6813:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a54f07b 00010000:00080000:3.0:1790945401.654066:0:6813:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb87b251000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:3.0:1790945401.654286:0:6813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1790945401.795679:0:6813:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1790945401.795704:0:6813:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790945401.796180:0:6813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790945401.796357:0:6813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790945401.796399:0:6813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1790945401.796450:0:6813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1790945401.797096:0:6815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945401.797101:0:6815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790945401.800932:0:6813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790945401.800949:0:6813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790945401.800985:0:6813:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790945401.801004:0:6813:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5cf2c2a6a54f082 00000100:00080000:3.0:1790945401.801015:0:6813:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790945401.801026:0:6813:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bb87b251000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1790945401.801058:0:6813:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb86c931880 x1877942273583360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790945401.801085:0:6813:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790945401.801148:0:6813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945401.801152:0:6813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945401.801154:0:6813:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790945401.801157:0:6813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945401.801161:0:6813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945401.801162:0:6813:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790945401.801165:0:6813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790945401.801167:0:6813:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790945401.801195:0:6813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6813:1877942273583488:0@lo:502: 00000100:00100000:3.0:1790945401.801273:0:6813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945401.801312:0:6813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb845ffa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945401.801348:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273583488 00000100:00100000:3.0:1790945401.801353:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273583488 00000100:00100000:3.0:1790945401.801385:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790945401.801393:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:6813:x1877942273583488:12345-0@lo:502: 00000100:00100000:3.0:1790945401.801600:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:6813:x1877942273583488:12345-0@lo:502: Request processed in 207us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945401.801608:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790945401.801674:0:6813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:6813:1877942273583488:0@lo:502: 00000020:01000000:3.0:1790945401.801697:0:6813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945401.801701:0:6813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945401.801703:0:6813:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790945401.801707:0:6813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1790945401.801855:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273583360:0@lo:8: 00000100:00100000:1.0:1790945401.801890:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945401.802244:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273583360 00000100:00100000:3.0:1790945401.802249:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273583360 00000100:00100000:3.0:1790945401.802608:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790945401.802614:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3291:x1877942273583360:12345-0@lo:8: 00010000:00080000:3.0:1790945401.802635:0:6670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:3.0:1790945401.802675:0:6670:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5cf2c2a6a54f089 00002000:00100000:3.0:1790945401.802709:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bb87b252800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790945401.802714:0:6670:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1790945401.802717:0:6670:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1790945401.802820:0:6670:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790945401.802968:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790945401.802990:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9bb87b252000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790945401.803045:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1877942273583360:12345-0@lo:8: Request processed in 429us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945401.803058:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:2.0:1790945401.808035:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1790945401.808069:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790945401.808079:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f06d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945401.808107:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f06d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945401.808117:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790945401.808120:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bb8656099c0 from 1 10000000:01000000:2.0:1790945401.808123:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790945401.808146:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945401.808155:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945401.808167:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945401.808186:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273583872:0@lo:101: 00000100:00100000:2.0:1790945401.808251:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945401.808285:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843442000 going to sleep for 11 seconds 00000100:00100000:2.0:1790945401.808306:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273583744:0@lo:400: 00000100:00100000:2.0:1790945401.808347:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945401.808374:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945401.808380:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273583616:0@lo:400: 00000100:00100000:2.0:1790945401.808402:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945401.808429:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273583872 00000100:00100000:2.0:1790945401.808436:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273583872 00000100:00100000:2.0:1790945401.808474:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790945401.808482:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273583872:12345-0@lo:101: 00010000:00010000:2.0:1790945401.814763:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945401.814787:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f097 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f090 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945401.814818:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f090 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945401.814829:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f090 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945401.814839:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4600, rc 0) 00000100:00100000:2.0:1790945401.814917:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273583872:12345-0@lo:101: Request processed in 6433us (6664us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945401.814926:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790945401.814982:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273583744 00000100:00100000:2.0:1790945401.814989:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273583744 00000100:00100000:2.0:1790945401.815040:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273583616 00000100:00100000:2.0:1790945401.815043:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273583616 00000100:00100000:2.0:1790945401.815058:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945401.815066:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273583744:12345-0@lo:400: 00000100:00100000:2.0:1790945401.815105:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273583744:12345-0@lo:400: Request processed in 39us (6757us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945401.815111:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945401.815124:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790945401.815130:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273583616:12345-0@lo:400: 00000100:00100000:2.0:1790945401.815158:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273583616:12345-0@lo:400: Request processed in 28us (6755us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945401.815164:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790945401.815211:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273583872:0@lo:101: 00010000:00010000:2.0:1790945401.815230:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f097 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945401.815239:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f097 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945401.815298:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273584000:0@lo:501: 00000100:00100000:2.0:1790945401.815343:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945401.815369:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843442000 going to sleep for 11 seconds 00000100:00080000:2.0:1790945401.815383:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790945401.815404:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb87b5c0000 x1877942273583616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945401.815415:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273583616:0@lo:400: 00010000:00080000:2.0:1790945401.815427:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb87b5c2d80 x1877942273583744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945401.815435:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273583744:0@lo:400: 00000100:00100000:2.0:1790945401.815457:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273584000 00000100:00100000:2.0:1790945401.815461:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273584000 00000100:00100000:2.0:1790945401.815481:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790945401.815487:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273584000:12345-0@lo:501: 00000100:00100000:2.0:1790945401.815796:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273584000:12345-0@lo:501: Request processed in 308us (451us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790945401.815802:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790945401.815902:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273584000:0@lo:501: 10000000:01000000:2.0:1790945401.815923:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790945401.815936:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f097 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945401.815945:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f097 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1790945401.816808:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86c931880 x1877942273583360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790945411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945401.816819:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790945401.816827:0:3291:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790945401.816833:0:3291:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790945401.816838:0:3291:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790945401.816842:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb87b251000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790945401.816865:0:3291:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790945401.816871:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273583360:0@lo:8: 00000004:00080000:2.0:1790945401.816895:0:6815:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790945401.817004:0:6815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 147612345886ns, next at 0ns, rc = 0 00000004:00080000:3.0:1790945401.910174:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1790945401.973701:0:6816:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790945401.973734:0:6816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1877942273584256:0@lo:7: 00000100:00100000:3.0:1790945401.973808:0:6816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945401.973862:0:6816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb845ffa300 going to sleep for 11 seconds 00000100:00100000:3.0:1790945401.973897:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273584128:0@lo:13: 00000100:00100000:3.0:1790945401.973922:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945401.973961:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273584256 00000100:00100000:3.0:1790945401.973968:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273584256 00000100:00100000:3.0:1790945401.974020:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945401.974029:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6816:x1877942273584256:12345-0@lo:7: 00000100:00080000:2.0:1790945401.978514:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945401.978548:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273584128 00000100:00100000:2.0:1790945401.978558:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273584128 00000100:00100000:2.0:1790945401.978606:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945401.978615:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1877942273584128:12345-0@lo:13: 00002000:00000024:2.0:1790945401.978648:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1790945401.978749:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1877942273584128:12345-0@lo:13: Request processed in 134us (4825us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945401.978756:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790945401.982838:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86c931c00 x1877942273584128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945401.982877:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273584128:0@lo:13: 00002000:00080000:3.0:1790945401.994250:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1790945401.994259:0:6673:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790945401.997135:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6816:x1877942273584256:12345-0@lo:7: Request processed in 23089us (23309us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945401.997154:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790945401.997355:0:6816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86c931f80 x1877942273584256/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790945417 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945401.997374:0:6816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1877942273584256:0@lo:7: 00000004:00080000:0.0:1790945401.997396:0:6816:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1790945401.998029:0:6816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1877942273584384:0@lo:5: 00000100:00100000:1.0:1790945401.998084:0:6816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945401.998130:0:6816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb877a12780 going to sleep for 11 seconds 00000100:00100000:3.0:1790945401.998181:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273584384 00000100:00100000:3.0:1790945401.998188:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273584384 00000100:00100000:3.0:1790945401.998238:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790945401.998246:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6816:x1877942273584384:12345-0@lo:5: 00002000:00080000:3.0:1790945401.998273:0:6670:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1790945401.998276:0:6670:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1790945401.998650:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6816:x1877942273584384:12345-0@lo:5: Request processed in 403us (564us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790945401.998783:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790945401.999225:0:6816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86cad5500 x1877942273584384/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790945417 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945401.999238:0:6816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1877942273584384:0@lo:5: 00000004:00080000:0.0:1790945401.999250:0:6816:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1790945401.999279:0:6816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1877942273584512:0@lo:700: 00000100:00100000:0.0:1790945401.999312:0:6816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945401.999354:0:6816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8654ab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945401.999405:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273584512 00000100:00100000:1.0:1790945401.999411:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273584512 00000100:00100000:1.0:1790945401.999441:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790945401.999448:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6816:x1877942273584512:12345-0@lo:700: 00000100:00100000:1.0:1790945401.999487:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fef480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6679:1877942273584640:0@lo:700: 00000100:00100000:1.0:1790945401.999527:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945401.999551:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb877a12780 going to sleep for 11 seconds 00000100:00100000:0.0:1790945401.999753:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273584640 00000100:00100000:0.0:1790945401.999757:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273584640 00000100:00100000:0.0:1790945401.999792:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790945401.999799:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6679:x1877942273584640:12345-0@lo:700: 40000000:02000000:0.0:1790945402.062520:0:5830:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1790945402.073885:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6679:x1877942273584640:12345-0@lo:700: Request processed in 74077us (74348us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945402.073905:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790945402.074000:0:6679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb872fef480 x1877942273584640/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790945417 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945402.074017:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fef480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6679:1877942273584640:0@lo:700: 40000000:02000000:2.0:1790945402.074031:0:6679:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1790945402.230465:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6816:x1877942273584512:12345-0@lo:700: Request processed in 231007us (231142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945402.230484:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790945402.230560:0:6816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86cad4a80 x1877942273584512/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790945417 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945402.230576:0:6816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1877942273584512:0@lo:700: 00000001:00080000:0.0:1790945402.232394:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1790945402.232417:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1790945402.359833:0:6816:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1790945402.375043:0:6816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1877942273584768:0@lo:5: 00000100:00100000:2.0:1790945402.375114:0:6816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945402.375165:0:6816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb856b01480 going to sleep for 11 seconds 00000100:00100000:2.0:1790945402.375191:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273584768 00000100:00100000:2.0:1790945402.375198:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273584768 00000100:00100000:2.0:1790945402.375246:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945402.375254:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6816:x1877942273584768:12345-0@lo:5: 00002000:00080000:2.0:1790945402.388357:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1790945402.388377:0:6673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1790945402.399011:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6816:x1877942273584768:12345-0@lo:5: Request processed in 23748us (23888us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790945402.399024:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790945402.405803:0:6816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb87b5c3800 x1877942273584768/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790945418 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945402.405822:0:6816:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790945402.405837:0:6816:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9bb87b5c3800 x1877942273584768/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790945418 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945402.405849:0:6816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1877942273584768:0@lo:5: 00000004:00080000:0.0:1790945402.405864:0:6816:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1790945402.598113:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945403.617296:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945404.639348:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945405.660295:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945406.689427:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790945406.979230:0:7039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1790945407.279050:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273584896:0@lo:13: 00000100:00100000:0.0:1790945407.279166:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945407.282221:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273584896 00000100:00100000:0.0:1790945407.282246:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273584896 00000100:00100000:0.0:1790945407.283863:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790945407.283882:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273584896:12345-0@lo:13: 00002000:00000024:0.0:1790945407.283930:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945407.284042:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273584896:12345-0@lo:13: Request processed in 167us (4877us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945407.284050:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790945407.284081:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790945407.284143:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86cad5500 x1877942273584896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945407.284182:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273584896:0@lo:13: 00000100:00100000:0.0:1790945407.287101:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273585280:0@lo:400: 00000100:00100000:0.0:1790945407.288425:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945407.288820:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273585280 00000100:00100000:0.0:1790945407.288846:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273585280 00000100:00100000:0.0:1790945407.288921:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790945407.288932:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273585280:12345-0@lo:400: 00000100:00100000:0.0:1790945407.289008:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273585280:12345-0@lo:400: Request processed in 78us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945407.289018:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1790945407.289052:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790945407.289101:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb87b5c3100 x1877942273585280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945407.289118:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273585280:0@lo:400: 00000100:00100000:2.0:1790945407.289885:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273585024:0@lo:400: 00000100:00100000:2.0:1790945407.289956:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945407.290025:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945407.290044:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273585152:0@lo:400: 00000100:00100000:2.0:1790945407.290076:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945407.290147:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273585024 00000100:00100000:2.0:1790945407.290154:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273585024 00000100:00100000:2.0:1790945407.290197:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790945407.290205:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:3294:x1877942273585024:12345-0@lo:400: 00000100:00100000:2.0:1790945407.290255:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:3294:x1877942273585024:12345-0@lo:400: Request processed in 50us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945407.294334:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790945407.294420:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273585152 00000100:00100000:2.0:1790945407.294429:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273585152 00000100:00100000:2.0:1790945407.294480:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790945407.294491:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273585152:12345-0@lo:400: 00000100:00100000:2.0:1790945407.294577:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273585152:12345-0@lo:400: Request processed in 87us (4500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945407.294584:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790945407.294632:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb87b5c0700 x1877942273585152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945407.294647:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273585152:0@lo:400: 00000100:00100000:2.0:1790945407.294681:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273585024:0@lo:400: 00000001:00080000:3.0:1790945407.382363:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1790945407.709066:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945408.734409:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945409.756722:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945410.781200:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945411.809988:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945412.383830:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273585408:0@lo:13: 00000100:00100000:0.0:1790945412.383903:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945412.383997:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273585408 00000100:00100000:0.0:1790945412.384006:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273585408 00000100:00100000:0.0:1790945412.384057:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790945412.384066:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273585408:12345-0@lo:13: 00002000:00000024:0.0:1790945412.384112:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945412.384156:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273585408:12345-0@lo:13: Request processed in 90us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945412.384164:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790945412.384392:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790945412.384620:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86cad4e00 x1877942273585408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945412.384632:0:3293:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790945412.384654:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273585408:0@lo:13: 00000100:00100000:0.0:1790945412.384980:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273585792:0@lo:400: 00000100:00100000:0.0:1790945412.385024:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945412.385058:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273585792 00000100:00100000:0.0:1790945412.385063:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273585792 00000100:00100000:0.0:1790945412.385094:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790945412.385193:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273585536:0@lo:400: 00000100:00100000:2.0:1790945412.385237:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945412.385269:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945412.385276:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273585664:0@lo:400: 00000100:00100000:2.0:1790945412.385302:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945412.385332:0:5825:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790945412.385347:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790945412.385376:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273585536 00000100:00100000:2.0:1790945412.385381:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273585536 00000100:00100000:2.0:1790945412.385411:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790945412.385432:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:3294:x1877942273585536:12345-0@lo:400: 00000100:00100000:2.0:1790945412.385619:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:3294:x1877942273585536:12345-0@lo:400: Request processed in 188us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945412.385628:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790945412.385685:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790945412.385691:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273585664 00000100:00100000:2.0:1790945412.385695:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273585664 00000100:00100000:2.0:1790945412.385712:0:5824:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790945412.385718:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790945412.385724:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273585664:12345-0@lo:400: 00000100:00100000:2.0:1790945412.385759:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273585664:12345-0@lo:400: Request processed in 35us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945412.385765:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1790945412.385793:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86cad6a00 x1877942273585664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945412.385803:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273585664:0@lo:400: 00000100:00100000:2.0:1790945412.385812:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273585536:0@lo:400: 00000100:00100000:0.0:1790945412.385869:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273585792:12345-0@lo:400: 00000100:00100000:0.0:1790945412.385913:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273585792:12345-0@lo:400: Request processed in 812us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945412.385920:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1790945412.385938:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790945412.385986:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86cad7480 x1877942273585792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945412.385996:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273585792:0@lo:400: 00010000:00010000:0.0:1790945412.831291:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945413.855376:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945414.876827:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945415.899992:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945416.936373:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945417.500821:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945417.500856:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273585920:0@lo:13: 00000100:00100000:1.0:1790945417.500932:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945417.501005:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273585920 00000100:00100000:1.0:1790945417.501011:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273585920 00000100:00100000:1.0:1790945417.501062:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790945417.501071:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273585920:12345-0@lo:13: 00002000:00000024:1.0:1790945417.502054:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945417.502127:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273585920:12345-0@lo:13: Request processed in 1056us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945417.502135:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1790945417.502161:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945417.502807:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790945417.502820:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273586304:0@lo:400: 00000100:00100000:3.0:1790945417.502859:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945417.503270:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273586048:0@lo:400: 00000100:00100000:2.0:1790945417.503308:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945417.503350:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945417.503356:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273586176:0@lo:400: 00000100:00100000:2.0:1790945417.503381:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945417.503410:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273586048 00000100:00100000:3.0:1790945417.503419:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273586048 00000100:00100000:2.0:1790945417.503421:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273586304 00000100:00100000:2.0:1790945417.503427:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273586304 00000100:00100000:3.0:1790945417.503461:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790945417.503471:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273586176 00000100:00100000:3.0:1790945417.503472:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:3294:x1877942273586048:12345-0@lo:400: 00000100:00100000:2.0:1790945417.503475:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273586176 00000100:00100000:2.0:1790945417.503497:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790945417.503505:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273586304:12345-0@lo:400: 00000100:00100000:3.0:1790945417.503533:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:3294:x1877942273586048:12345-0@lo:400: Request processed in 63us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945417.503542:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790945417.503551:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273586304:12345-0@lo:400: Request processed in 45us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945417.503558:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790945417.503574:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790945417.503581:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273586176:12345-0@lo:400: 00000100:00100000:2.0:1790945417.503603:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273586176:12345-0@lo:400: Request processed in 24us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945417.503609:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790945417.503741:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790945417.504065:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86cad4000 x1877942273585920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945417.504084:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273585920:0@lo:13: 00010000:00080000:2.0:1790945417.504317:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86c932680 x1877942273586176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945417.504328:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273586176:0@lo:400: 00000100:00100000:2.0:1790945417.504340:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273586048:0@lo:400: 00010000:00080000:2.0:1790945417.504379:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86c930e00 x1877942273586304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945417.504390:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273586304:0@lo:400: 00010000:00010000:2.0:1790945417.948810:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945418.973812:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945419.995798:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790945420.285299:0:7608:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790945420.285304:0:7608:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1790945420.285558:0:7608:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bb87fbcd800 00000020:01000004:3.0:1790945420.285574:0:7608:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790945420.285586:0:7608:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1790945420.285598:0:7608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bb865fecd40) 00000020:00000080:3.0:1790945420.285612:0:7608:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790945420.300216:0:7608:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790945420.300583:0:7608:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790945420.323956:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790945420.333308:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790945420.333346:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790945420.333486:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790945420.333513:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790945420.333926:0:7608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790945420.333938:0:7608:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790945420.333946:0:7608:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc5cf2c2a6a54f0a5 00000020:01000004:3.0:1790945420.333953:0:7608:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1790945420.333980:0:7608:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790945420.333984:0:7608:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790945420.333989:0:7608:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790945420.334008:0:7608:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1790945420.334012:0:7608:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790945420.348555:0:7608:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790945420.348598:0:7608:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.148@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1790945420.348602:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790945420.348604:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790945420.348605:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945420.348607:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790945420.348608:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945420.348609:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945420.348611:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790945420.348612:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790945420.348614:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790945420.348615:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945420.348617:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790945420.348621:0:7608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1790945420.348623:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790945420.348625:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790945420.348626:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945420.348627:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790945420.348628:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945420.348629:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945420.348630:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790945420.348631:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790945420.348632:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790945420.348633:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945420.348634:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790945420.348740:0:7608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790945420.348761:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273586432:0@lo:253: 00000100:00100000:3.0:1790945420.348828:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945420.348949:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881633000 going to sleep for 11 seconds 00000100:00100000:2.0:1790945420.349030:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273586432 00000100:00100000:2.0:1790945420.349039:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273586432 00000100:00100000:2.0:1790945420.349118:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790945420.349128:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:7608:x1877942273586432:12345-0@lo:253: 20000000:01000000:2.0:1790945420.349274:0:5817:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790945420.349279:0:5817:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1790945420.349284:0:5817:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1790945420.349287:0:5817:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1790945420.350312:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945420.350529:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1790945420.350544:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1790945420.350596:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1790945420.350605:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1790945420.350633:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1790945420.350706:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1790945420.351077:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1790945420.351095:0:5817:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.148@tcp 20000000:01000000:2.0:1790945420.351097:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.148@tcp (null) (null) (null) 00000040:00080000:2.0:1790945420.351131:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1790945420.351162:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790945420.351210:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1790945420.351219:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.148@tcp (null) (null) 00000040:00080000:2.0:1790945420.351251:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1790945420.351260:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1790945420.351291:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1790945420.351339:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1790945420.352001:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1790945420.352015:0:5817:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.148@tcp 20000000:01000000:2.0:1790945420.352021:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.148@tcp (null) (null) (null) 00000040:00080000:2.0:1790945420.352050:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1790945420.352057:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790945420.352080:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1790945420.352085:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.148@tcp (null) (null) 00000040:00080000:2.0:1790945420.352108:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1790945420.352115:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790945420.352759:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1790945420.352808:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1790945420.352828:0:5817:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790945420.352831:0:5817:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790945420.352834:0:5817:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790945420.352846:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790945420.352849:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790945420.352885:0:5817:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790945420.352887:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790945420.353614:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1790945420.354021:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1790945420.354066:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1790945420.354510:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1790945420.354553:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1790945420.354603:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1790945420.354615:0:5817:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790945420.354617:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790945420.355209:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1790945420.355287:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1790945420.355345:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1790945420.355652:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1790945420.355717:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1790945420.355747:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1790945420.355757:0:5817:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790945420.355759:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790945420.356149:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1790945420.356320:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1790945420.356353:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1790945420.356486:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1790945420.356498:0:5817:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790945420.356500:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790945420.356981:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1790945420.357026:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1790945420.357075:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1790945420.357296:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1790945420.357335:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1790945420.357460:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1790945420.357476:0:5817:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1790945420.357478:0:5817:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1790945420.357486:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790945420.357503:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.357521:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8821c4800/0xc5cf2c2a6a54effd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54eff6 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.357529:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f020 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.357537:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb840030400/0xc5cf2c2a6a54f051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f04a expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.357544:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f06d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f066 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.357551:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f090 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.357558:0:5817:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.357593:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f090 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.357618:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f097 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f090 expref: 16 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945420.357633:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5817:1877942273586560:0@lo:104: 00000100:00100000:0.0:1790945420.357724:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790945420.357823:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f066 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.357831:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f06d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f066 expref: 16 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945420.357840:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5817:1877942273586688:0@lo:104: 00010000:00010000:0.0:1790945420.357875:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb840030400/0xc5cf2c2a6a54f051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f04a expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.357883:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb840030400/0xc5cf2c2a6a54f051 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f04a expref: 16 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945420.357891:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5817:1877942273586816:0@lo:104: 00010000:00010000:0.0:1790945420.357914:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f020 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.357921:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f020 expref: 16 pid: 5817 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945420.357928:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5817:1877942273586944:0@lo:104: 00010000:00010000:0.0:1790945420.357945:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8821c4800/0xc5cf2c2a6a54effd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54eff6 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.357962:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8821c4800/0xc5cf2c2a6a54effd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54eff6 expref: 16 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945420.357972:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5817:1877942273587072:0@lo:104: 00000100:00100000:0.0:1790945420.357990:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb86c86e300 going to sleep for 11 seconds 00000100:00100000:2.0:1790945420.358346:0:5807:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790945420.358366:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945420.358502:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945420.358559:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945420.358576:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273586560 00000100:00100000:1.0:1790945420.358582:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273586560 00000100:00100000:1.0:1790945420.358622:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273586688 00000100:00100000:1.0:1790945420.358624:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273586688 00000100:00100000:1.0:1790945420.358634:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273586816 00000100:00100000:1.0:1790945420.358636:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273586816 00000100:00100000:1.0:1790945420.358648:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790945420.358682:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb85820dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+5:5817:x1877942273586560:12345-0@lo:104: 00010000:00010000:1.0:1790945420.358695:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f097 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.358761:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790945420.358767:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb85820dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+5:5817:x1877942273586560:12345-0@lo:104: Request processed in 113us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945420.358781:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790945420.358830:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790945420.358837:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:5817:x1877942273586688:12345-0@lo:104: 00010000:00010000:1.0:1790945420.358844:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f06d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.358872:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790945420.358876:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:5817:x1877942273586688:12345-0@lo:104: Request processed in 41us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945420.358881:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790945420.358892:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790945420.358899:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5817:x1877942273586816:12345-0@lo:104: 00010000:00010000:1.0:1790945420.358907:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f051 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.358929:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790945420.358934:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5817:x1877942273586816:12345-0@lo:104: Request processed in 36us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945420.358939:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1790945420.359022:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790945420.359029:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f097 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359037:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1790945420.359042:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f097 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359051:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f097 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945420.359058:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f097 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945420.359065:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790945420.359091:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f097 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359098:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945420.359116:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f097 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359123:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f097 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359155:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790945420.359159:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f06d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359164:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1790945420.359166:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f06d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359172:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f06d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945420.359178:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f06d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945420.359183:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790945420.359195:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f06d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359201:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945420.359214:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f06d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359220:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb840031200/0xc5cf2c2a6a54f066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f06d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359234:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945420.359237:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f051 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359254:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1790945420.359257:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f051 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359263:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f051 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945420.359269:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f051 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945420.359273:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790945420.359285:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f051 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359290:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945420.359295:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f051 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359302:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a54f04a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f051 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359311:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945420.359313:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945420.359315:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945420.359338:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273587200:0@lo:103: 00000100:00100000:3.0:1790945420.359380:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945420.359425:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273587328:0@lo:103: 00000100:00100000:3.0:1790945420.359447:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945420.359471:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945420.359476:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273587456:0@lo:103: 00000100:00100000:3.0:1790945420.359495:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945420.359521:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273587200 00000100:00100000:3.0:1790945420.359526:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273587200 00010000:00010000:3.0:1790945420.359546:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f097 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f090 expref: 17 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945420.359559:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273587328 00000100:00100000:3.0:1790945420.359562:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273587328 00010000:00010000:3.0:1790945420.359571:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f06d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f066 expref: 18 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945420.359581:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273587456 00000100:00100000:3.0:1790945420.359583:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273587456 00010000:00010000:3.0:1790945420.359607:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb840030400/0xc5cf2c2a6a54f051 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f04a expref: 19 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945420.359621:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790945420.359627:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273587200:12345-0@lo:103: 00010000:00010000:3.0:1790945420.359636:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945420.359641:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f097 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f090 expref: 19 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359650:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f097 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f090 expref: 19 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359687:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945420.359716:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273587200:12345-0@lo:103: Request processed in 89us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945420.359722:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790945420.359746:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790945420.359752:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:3294:x1877942273587328:12345-0@lo:103: 00010000:00010000:3.0:1790945420.359760:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945420.359764:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f06d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f066 expref: 18 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359773:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f06d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f066 expref: 18 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359782:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945420.359807:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:3294:x1877942273587328:12345-0@lo:103: Request processed in 55us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945420.359812:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790945420.359824:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790945420.359829:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:3294:x1877942273587456:12345-0@lo:103: 00010000:00010000:3.0:1790945420.359835:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945420.359839:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb840030400/0xc5cf2c2a6a54f051 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f04a expref: 17 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359848:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb840030400/0xc5cf2c2a6a54f051 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f04a expref: 17 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.359857:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945420.359876:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:3294:x1877942273587456:12345-0@lo:103: Request processed in 48us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945420.359895:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790945420.359932:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273587200:0@lo:103: 00000100:00100000:3.0:1790945420.359956:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273587456:0@lo:103: 00000100:00100000:3.0:1790945420.359971:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273587328:0@lo:103: 00010000:00010000:0.0:1790945420.360353:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945420.360384:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f097 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f090 expref: 16 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945420.360396:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5817:1877942273586560:0@lo:104: 00010000:00010000:0.0:1790945420.360406:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f06d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f066 expref: 15 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945420.360414:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5817:1877942273586688:0@lo:104: 00010000:00010000:0.0:1790945420.360423:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb840030400/0xc5cf2c2a6a54f051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f04a expref: 14 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945420.360433:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5817:1877942273586816:0@lo:104: 00000100:00100000:2.0:1790945420.360587:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945420.361226:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273586944 00000100:00100000:1.0:1790945420.361233:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273586944 00000100:00100000:1.0:1790945420.361261:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273587072 00000100:00100000:1.0:1790945420.361263:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273587072 00000100:00100000:1.0:1790945420.361276:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790945420.361284:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:5817:x1877942273586944:12345-0@lo:104: 00010000:00010000:1.0:1790945420.361297:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f027 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945420.361537:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5817:1877942273586944:0@lo:104: 00010000:00010000:1.0:1790945420.361565:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790945420.361571:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:5817:x1877942273586944:12345-0@lo:104: Request processed in 289us (3011us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945420.361579:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790945420.361595:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790945420.361600:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5817:x1877942273587072:12345-0@lo:104: 00010000:00010000:1.0:1790945420.361607:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54effd expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945420.361691:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5817:1877942273587072:0@lo:104: 00010000:00010000:0.0:1790945420.361716:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945420.361763:0:5807:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1790945420.361772:0:5807:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1790945420.362014:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790945420.362021:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f027 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362028:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167bc00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1790945420.362031:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f027 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362039:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f027 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945420.362046:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f027 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945420.362052:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790945420.362080:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f027 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362086:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945420.362100:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f027 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362107:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a54f020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f027 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362119:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945420.362123:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54effd expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362138:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167ae00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1790945420.362150:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54effd expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362158:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54effd expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945420.362164:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54effd expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945420.362169:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790945420.362183:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54effd expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362190:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945420.362196:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54effd expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362202:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54eff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54effd expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362216:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945420.362218:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945420.362220:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945420.362232:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273587584:0@lo:103: 00000100:00100000:3.0:1790945420.362266:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945420.362301:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945420.362307:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273587712:0@lo:103: 00000100:00100000:3.0:1790945420.362498:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945420.362536:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273587584 00000100:00100000:3.0:1790945420.362540:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273587584 00010000:00010000:3.0:1790945420.362558:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f020 expref: 14 pid: 5817 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945420.362577:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273587712 00000100:00100000:3.0:1790945420.362580:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273587712 00010000:00010000:3.0:1790945420.362589:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8821c4800/0xc5cf2c2a6a54effd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54eff6 expref: 15 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945420.362601:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790945420.362606:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:3292:x1877942273587584:12345-0@lo:103: 00010000:00010000:3.0:1790945420.362615:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945420.362620:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f020 expref: 15 pid: 5817 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362628:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f020 expref: 15 pid: 5817 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362641:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f020 expref: 15 pid: 5817 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362654:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945420.362699:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:3292:x1877942273587584:12345-0@lo:103: Request processed in 93us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945420.362705:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790945420.362718:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790945420.362724:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:3292:x1877942273587712:12345-0@lo:103: 00010000:00010000:3.0:1790945420.362730:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945420.362739:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8821c4800/0xc5cf2c2a6a54effd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54eff6 expref: 13 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362748:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8821c4800/0xc5cf2c2a6a54effd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54eff6 expref: 13 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362757:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c4800/0xc5cf2c2a6a54effd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54eff6 expref: 13 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362770:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362777:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362788:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362795:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362801:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362806:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362811:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945420.362815:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362821:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362848:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.362858:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945420.362880:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:3292:x1877942273587712:12345-0@lo:103: Request processed in 157us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945420.362886:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790945420.362913:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273587712:0@lo:103: 00000100:00100000:3.0:1790945420.362921:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273587584:0@lo:103: 00010000:00010000:0.0:1790945420.363025:0:5817:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.363033:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.363045:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0ac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790945420.363061:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1790945420.363257:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1790945420.363264:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5817:x1877942273587072:12345-0@lo:104: Request processed in 1663us (2677us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945420.363270:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1790945420.363333:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945420.403706:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:7608:x1877942273586432:12345-0@lo:253: Request processed in 54570us (54868us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945420.403722:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790945420.403869:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273586432:0@lo:253: 10000000:01000000:1.0:1790945420.403884:0:7608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790945420.403888:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790945420.403890:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790945420.403891:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945420.403892:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1790945420.403893:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945420.403894:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945420.403896:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790945420.403897:0:7608:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790945420.403898:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945420.403899:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790945420.403917:0:7608:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bb87fbcd800 from lustre-OST0001 10000000:01000000:1.0:1790945420.403954:0:7608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1790945420.403957:0:7608:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790945420.403965:0:7608:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bb8656099c0 local copy 10000000:01000000:1.0:1790945420.403979:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790945420.404013:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.404025:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.404035:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945420.404052:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273587840:0@lo:101: 00000100:00100000:1.0:1790945420.404085:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945420.404202:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273587840 00000100:00100000:2.0:1790945420.404210:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273587840 00000100:00100000:2.0:1790945420.404252:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790945420.404262:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+11:7608:x1877942273587840:12345-0@lo:101: 00010000:00010000:2.0:1790945420.404275:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945420.404289:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f0ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f0b3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.404311:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f0b3 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.404331:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f0b3 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.404341:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c5000, rc 0) 00000100:00100000:2.0:1790945420.404828:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:7608:x1877942273587840:12345-0@lo:101: Request processed in 567us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945420.404845:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790945420.405165:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f600 going to sleep for 11 seconds 00000100:00100000:1.0:1790945420.405182:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273587840:0@lo:101: 00010000:00010000:1.0:1790945420.405198:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc5cf2c2a6a54f0ba expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.405208:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc5cf2c2a6a54f0ba expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945420.405310:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273587968:0@lo:501: 00000100:00100000:1.0:1790945420.405352:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945420.405459:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273587968 00000100:00100000:0.0:1790945420.405464:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273587968 00000100:00100000:0.0:1790945420.405499:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790945420.405506:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:7608:x1877942273587968:12345-0@lo:501: 00000100:00100000:1.0:1790945420.405720:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f600 going to sleep for 11 seconds 00000100:00100000:0.0:1790945420.405915:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:7608:x1877942273587968:12345-0@lo:501: Request processed in 410us (562us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790945420.405922:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790945420.406082:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273587968:0@lo:501: 10000000:01000000:1.0:1790945420.406096:0:7608:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790945420.406121:0:7608:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790945420.406127:0:7608:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc5cf2c2a6a54f0ba expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.406154:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc5cf2c2a6a54f0ba expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.406162:0:7608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc5cf2c2a6a54f0ba expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.406208:0:7608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790945420.406230:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bb87fbcd800 10000000:01000000:1.0:1790945420.406235:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790945420.406240:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790945420.406242:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790945420.406246:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790945420.406249:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790945420.406265:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.406273:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.406281:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945420.406291:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588096:0@lo:101: 00000100:00100000:1.0:1790945420.406328:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945420.406480:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f780 going to sleep for 11 seconds 00000100:00100000:2.0:1790945420.406516:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273588096 00000100:00100000:2.0:1790945420.406520:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273588096 00000100:00100000:2.0:1790945420.406577:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790945420.406585:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:7608:x1877942273588096:12345-0@lo:101: 00010000:00010000:2.0:1790945420.406593:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945420.406602:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f0c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f0c1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.406618:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f0c1 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.406627:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f0c1 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.406635:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4600, rc 0) 00000100:00100000:2.0:1790945420.406685:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:7608:x1877942273588096:12345-0@lo:101: Request processed in 101us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945420.406691:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790945420.406750:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588096:0@lo:101: 00010000:00010000:1.0:1790945420.406760:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f0c8 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.406779:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f0c8 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945420.406841:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588224:0@lo:501: 00000100:00100000:1.0:1790945420.406865:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790945420.406903:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945420.406910:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc5cf2c2a6a54f0ba expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.406916:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167ba00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1790945420.406920:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc5cf2c2a6a54f0ba expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.406928:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc5cf2c2a6a54f0ba expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945420.406935:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc5cf2c2a6a54f0ba expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945420.406941:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790945420.406958:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc5cf2c2a6a54f0ba expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.406964:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945420.406983:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc5cf2c2a6a54f0ba expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.406990:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb84167ba00/0xc5cf2c2a6a54f0b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc5cf2c2a6a54f0ba expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.407000:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945420.407001:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945420.407003:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945420.407014:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273588352:0@lo:103: 00000100:00100000:3.0:1790945420.407041:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945420.407074:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273588352 00000100:00100000:3.0:1790945420.407077:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273588352 00000100:00100000:3.0:1790945420.407105:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945420.407112:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:3294:x1877942273588352:12345-0@lo:103: 00010000:00010000:3.0:1790945420.407120:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945420.407130:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f0ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f0b3 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.407138:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945420.407174:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:3294:x1877942273588352:12345-0@lo:103: Request processed in 62us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945420.407180:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945420.407205:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273588352:0@lo:103: 00000100:00100000:1.0:1790945420.407301:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f780 going to sleep for 11 seconds 00000100:00100000:0.0:1790945420.407427:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273588224 00000100:00100000:0.0:1790945420.407432:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273588224 00000100:00100000:0.0:1790945420.407453:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790945420.407458:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:7608:x1877942273588224:12345-0@lo:501: 00000100:00100000:0.0:1790945420.407717:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:7608:x1877942273588224:12345-0@lo:501: Request processed in 258us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945420.407724:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790945420.407928:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588224:0@lo:501: 00000100:00100000:1.0:1790945420.407953:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588480:0@lo:503: 00000100:00100000:1.0:1790945420.407986:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945420.408039:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f780 going to sleep for 11 seconds 00000100:00100000:0.0:1790945420.408069:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273588480 00000100:00100000:0.0:1790945420.408073:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273588480 00000100:00100000:0.0:1790945420.408125:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790945420.408132:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:7608:x1877942273588480:12345-0@lo:503: 00000100:00100000:0.0:1790945420.408288:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:7608:x1877942273588480:12345-0@lo:503: Request processed in 156us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945420.408299:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790945420.408358:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588480:0@lo:503: 00000040:00080000:1.0:1790945420.408636:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790945420.408718:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588608:0@lo:502: 00000100:00100000:1.0:1790945420.408752:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945420.409355:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f780 going to sleep for 11 seconds 00000100:00100000:2.0:1790945420.409515:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273588608 00000100:00100000:2.0:1790945420.409522:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273588608 00000100:00100000:2.0:1790945420.409549:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790945420.409556:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:7608:x1877942273588608:12345-0@lo:502: 00000100:00100000:2.0:1790945420.409783:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:7608:x1877942273588608:12345-0@lo:502: Request processed in 226us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945420.409790:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790945420.409950:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588608:0@lo:502: 00000040:00080000:1.0:1790945420.410188:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790945420.410230:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1790945420.410256:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1790945420.410601:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1790945420.410632:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1790945420.410689:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1790945420.410718:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588736:0@lo:502: 00000100:00100000:1.0:1790945420.410759:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945420.410843:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f780 going to sleep for 11 seconds 00000100:00100000:3.0:1790945420.410943:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273588736 00000100:00100000:3.0:1790945420.410949:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273588736 00000100:00100000:2.0:1790945420.410994:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790945420.411002:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:7608:x1877942273588736:12345-0@lo:502: 00000100:00100000:2.0:1790945420.411157:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:7608:x1877942273588736:12345-0@lo:502: Request processed in 156us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945420.411164:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790945420.411247:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588736:0@lo:502: 00000040:00080000:1.0:1790945420.411331:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790945420.411341:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1790945420.411954:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790945420.411960:0:7616:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790945420.411966:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945420.411969:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790945420.411973:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790945420.411993:0:7616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bb87b47cd40) 00000020:00000080:1.0:1790945420.412013:0:7616:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790945420.412021:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790945420.412075:0:7616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb87fbcd800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790945420.412082:0:7616:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790945420.412088:0:7616:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc5cf2c2a6a54f0d6 00010000:00010000:1.0:1790945420.415589:0:7616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1790945420.415884:0:7616:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1790945420.418483:0:7616:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1790945420.418827:0:7616:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1790945420.422577:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1790945420.423259:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1790945420.424911:0:7616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790945420.424922:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945420.424928:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945420.424931:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790945420.424934:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945420.424939:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945420.424940:0:7616:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790945420.424944:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790945420.424946:0:7616:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790945420.424988:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945420.424991:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945420.424993:0:7616:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790945420.425002:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1790945420.425132:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1790945420.425173:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790945420.425195:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f0c8 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.425207:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f0c8 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945420.425214:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb87fbcd800 from 1 10000000:01000000:2.0:1790945420.425217:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790945420.425252:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.425261:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.425271:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945420.425292:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588864:0@lo:101: 00000100:00100000:2.0:1790945420.425366:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945420.425409:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fa166c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945420.425604:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273588864 00000100:00100000:0.0:1790945420.425613:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273588864 00000100:00100000:0.0:1790945420.425681:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790945420.425691:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:7608:x1877942273588864:12345-0@lo:101: 00010000:00010000:0.0:1790945420.425705:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945420.425717:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f0dd expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.425738:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f0dd expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.425749:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f0dd expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.425758:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840031400, rc 0) 00000100:00100000:0.0:1790945420.425799:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:7608:x1877942273588864:12345-0@lo:101: Request processed in 111us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945420.425806:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790945420.425901:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588864:0@lo:101: 00010000:00010000:1.0:1790945420.425914:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f0e4 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.425922:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f0e4 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945420.426004:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588992:0@lo:501: 00000100:00100000:1.0:1790945420.426030:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945420.426049:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f600 going to sleep for 11 seconds 00000100:00100000:0.0:1790945420.426096:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273588992 00000100:00100000:0.0:1790945420.426100:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273588992 00000100:00100000:0.0:1790945420.426126:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790945420.426131:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:7608:x1877942273588992:12345-0@lo:501: 00000100:00100000:0.0:1790945420.426365:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:7608:x1877942273588992:12345-0@lo:501: Request processed in 233us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945420.426506:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273588992:0@lo:501: 00000100:00100000:1.0:1790945420.426532:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589120:0@lo:503: 00000100:00100000:1.0:1790945420.426566:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945420.426580:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f600 going to sleep for 11 seconds 00000100:00100000:1.0:1790945420.426592:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273589120 00000100:00100000:1.0:1790945420.426595:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273589120 00000100:00100000:1.0:1790945420.426614:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790945420.426619:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7608:x1877942273589120:12345-0@lo:503: 00000100:00100000:1.0:1790945420.426912:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7608:x1877942273589120:12345-0@lo:503: Request processed in 292us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945420.426920:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790945420.426958:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589120:0@lo:503: 00000040:00080000:1.0:1790945420.427207:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790945420.427257:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589248:0@lo:502: 00000100:00100000:1.0:1790945420.427288:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945420.427316:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f600 going to sleep for 11 seconds 00000100:00100000:0.0:1790945420.427576:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790945420.427609:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273589248 00000100:00100000:0.0:1790945420.427613:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273589248 00000100:00100000:0.0:1790945420.427634:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790945420.427640:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:7608:x1877942273589248:12345-0@lo:502: 00000100:00100000:0.0:1790945420.427806:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:7608:x1877942273589248:12345-0@lo:502: Request processed in 166us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945420.427813:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790945420.427909:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589248:0@lo:502: 00000040:00080000:1.0:1790945420.428169:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1790945420.428213:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1790945420.428239:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589376:0@lo:502: 00000100:00100000:1.0:1790945420.428269:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945420.428288:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f600 going to sleep for 11 seconds 00000100:00100000:1.0:1790945420.428303:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273589376 00000100:00100000:1.0:1790945420.428307:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273589376 00000100:00100000:1.0:1790945420.428324:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790945420.428329:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:7608:x1877942273589376:12345-0@lo:502: 00000100:00100000:1.0:1790945420.428870:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:7608:x1877942273589376:12345-0@lo:502: Request processed in 538us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945420.428877:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790945420.432308:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589376:0@lo:502: 00000040:00080000:1.0:1790945420.432764:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1790945420.432782:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1790945420.433440:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945420.433449:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945420.433451:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790945420.433457:0:7620:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb87fbcd800 00000020:00000080:1.0:1790945420.433459:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790945420.433474:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945420.433477:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945420.433478:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790945420.433481:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1790945420.433644:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790945420.433692:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790945420.433709:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f0e4 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.433721:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f0e4 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945420.433765:0:7608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790945420.433769:0:7608:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bb87fbcd800 10000000:01000000:0.0:1790945420.433772:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bb87fbcd800 10000000:01000000:0.0:1790945420.433776:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790945420.433781:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bb87fbcd800 from 1 10000000:01000000:0.0:1790945420.433784:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790945420.433817:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.433825:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.433835:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945420.433866:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589504:0@lo:101: 00000100:00100000:0.0:1790945420.433936:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945420.433971:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b5663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945420.434037:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273589504 00000100:00100000:2.0:1790945420.434045:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273589504 00000100:00100000:2.0:1790945420.434093:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790945420.434102:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:7608:x1877942273589504:12345-0@lo:101: 00010000:00010000:2.0:1790945420.434123:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945420.434135:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54f0f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f0eb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.434167:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54f0f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f0eb expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.434178:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54f0f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f0eb expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.434185:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4200, rc 0) 00000100:00100000:2.0:1790945420.434253:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7608:x1877942273589504:12345-0@lo:101: Request processed in 152us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945420.434260:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790945420.434461:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589504:0@lo:101: 00010000:00010000:0.0:1790945420.434475:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f0f2 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.434484:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f0f2 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945420.434559:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589632:0@lo:501: 00000100:00100000:0.0:1790945420.434586:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945420.434614:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b5663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945420.434685:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273589632 00000100:00100000:2.0:1790945420.434690:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273589632 00000100:00100000:2.0:1790945420.434714:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790945420.434721:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7608:x1877942273589632:12345-0@lo:501: 00000100:00100000:2.0:1790945420.434913:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7608:x1877942273589632:12345-0@lo:501: Request processed in 192us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945420.434920:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790945420.435129:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589632:0@lo:501: 00000100:00100000:0.0:1790945420.435168:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589760:0@lo:503: 00000100:00100000:0.0:1790945420.435206:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945420.435232:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b5663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945420.435282:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273589760 00000100:00100000:1.0:1790945420.435286:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273589760 00000100:00100000:1.0:1790945420.435317:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790945420.435333:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7608:x1877942273589760:12345-0@lo:503: 00000100:00100000:1.0:1790945420.435600:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7608:x1877942273589760:12345-0@lo:503: Request processed in 268us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945420.435607:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790945420.435745:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589760:0@lo:503: 00000040:00080000:0.0:1790945420.436017:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790945420.436069:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589888:0@lo:502: 00000100:00100000:0.0:1790945420.436103:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945420.436122:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b5663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945420.436208:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273589888 00000100:00100000:2.0:1790945420.436212:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273589888 00000100:00100000:2.0:1790945420.436239:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790945420.436246:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7608:x1877942273589888:12345-0@lo:502: 00000100:00100000:2.0:1790945420.436534:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7608:x1877942273589888:12345-0@lo:502: Request processed in 288us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945420.436541:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790945420.436698:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273589888:0@lo:502: 00000040:00080000:0.0:1790945420.436914:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790945420.436963:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790945420.436992:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790945420.437036:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790945420.437075:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790945420.437121:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790945420.437170:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790945420.437203:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790945420.437257:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790945420.437292:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790945420.441534:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790945420.443645:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790945420.443858:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790945420.443894:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790945420.443950:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790945420.443983:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790945420.444018:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790945420.444060:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790945420.444096:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790945420.444127:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790945420.444187:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790945420.444220:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790945420.444274:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790945420.444455:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790945420.444497:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1790945420.444535:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1790945420.444580:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1790945420.444614:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1790945420.444643:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1790945420.444833:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1790945420.444870:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1790945420.444904:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1790945420.444933:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1790945420.444979:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1790945420.445013:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1790945420.445058:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1790945420.445092:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1790945420.445150:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273590016:0@lo:502: 00000100:00100000:1.0:1790945420.445233:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945420.445317:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f780 going to sleep for 11 seconds 00000100:00100000:2.0:1790945420.445470:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273590016 00000100:00100000:2.0:1790945420.445477:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273590016 00000100:00100000:2.0:1790945420.450227:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790945420.450251:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7608:x1877942273590016:12345-0@lo:502: 00000100:00100000:2.0:1790945420.450687:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7608:x1877942273590016:12345-0@lo:502: Request processed in 447us (5453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945420.450697:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790945420.450836:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273590016:0@lo:502: 00000040:00080000:3.0:1790945420.450945:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1790945420.450968:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1790945420.451632:0:7621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790945420.451646:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bb865fe8000) 00000020:00000080:3.0:1790945420.451770:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1790945420.451883:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb87fbcd800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790945420.451887:0:7621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb87fbcd800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790945420.451889:0:7621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bb87fbcd800 3 00010000:00080000:2.0:1790945420.451914:0:7621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb87fb61000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.148@tcp at head 00010000:00010000:2.0:1790945420.453994:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1790945420.454241:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790945420.454277:0:7621:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790945420.454293:0:7621:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc5cf2c2a6a54f100 00000100:00080000:2.0:1790945420.454305:0:7621:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790945420.454328:0:7621:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bb87fb61000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1790945420.454381:0:7621:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87b5c1880 x1877942273590144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790945420.454410:0:7621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790945420.454721:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790945420.454736:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273590272:0@lo:400: 00000100:00100000:0.0:1790945420.454816:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945420.454858:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273590400:0@lo:400: 00000100:00100000:0.0:1790945420.454881:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945420.454898:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945420.454903:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273590528:0@lo:400: 00000100:00100000:0.0:1790945420.454925:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945420.454955:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273590272 00000100:00100000:0.0:1790945420.454962:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273590272 00000100:00100000:0.0:1790945420.454995:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273590400 00000100:00100000:0.0:1790945420.454997:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273590400 00000100:00100000:0.0:1790945420.455027:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790945420.455035:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273590272:12345-0@lo:400: 00000100:00100000:0.0:1790945420.455079:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273590272:12345-0@lo:400: Request processed in 45us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945420.455087:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790945420.455101:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790945420.455107:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273590400:12345-0@lo:400: 00000100:00100000:0.0:1790945420.455133:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273590400:12345-0@lo:400: Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945420.455151:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790945420.455184:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273590528 00000100:00100000:0.0:1790945420.455188:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273590528 00000100:00100000:0.0:1790945420.455212:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790945420.455219:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273590528:12345-0@lo:400: 00000100:00100000:0.0:1790945420.455249:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273590528:12345-0@lo:400: Request processed in 30us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945420.455255:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790945420.455272:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945420.455276:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790945420.455304:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86cad4e00 x1877942273590528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945420.455317:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273590528:0@lo:400: 00010000:00080000:0.0:1790945420.455327:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86cad6a00 x1877942273590400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945420.455336:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273590400:0@lo:400: 00010000:00080000:0.0:1790945420.455363:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86cad6300 x1877942273590272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945420.455723:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273590272:0@lo:400: 00000100:00100000:3.0:1790945420.455814:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1877942273590144:0@lo:38: 00000100:00100000:3.0:1790945420.455847:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1790945420.456127:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1790945420.456237:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1790945420.456265:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790945420.456284:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f0f2 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.456295:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f0f2 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790945420.456362:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790945420.456364:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790945420.456366:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790945420.456367:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790945420.456517:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790945420.456520:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790945420.456521:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790945420.456523:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790945420.456524:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790945420.456525:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790945420.456526:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790945420.456530:0:7608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1790945420.456532:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790945420.456533:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790945420.456535:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790945420.456536:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790945420.456537:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790945420.456538:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790945420.456539:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790945420.456540:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790945420.456541:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790945420.456542:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790945420.456543:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790945420.456560:0:7608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790945420.456572:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273590656:0@lo:253: 00000100:00100000:2.0:1790945420.456619:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945420.456643:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb850ec20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945420.456971:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273590144 00000100:00100000:0.0:1790945420.456978:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273590144 00000100:00100000:0.0:1790945420.457008:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790945420.457014:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3291:x1877942273590144:12345-0@lo:38: 00010000:00080000:0.0:1790945420.457035:0:7211:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:0.0:1790945420.457062:0:7211:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc5cf2c2a6a54f107 00000004:00100000:0.0:1790945420.457076:0:7211:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790945420.457104:0:7211:0:(import.c:65:import_set_state_nolock()) ffff9bb8818f1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790945420.457174:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1877942273590144:12345-0@lo:38: Request processed in 157us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945420.457182:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790945420.457218:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb87b5c1880 x1877942273590144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790945430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945420.457227:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790945420.457235:0:3291:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1790945420.457242:0:3291:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790945420.457245:0:3291:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790945420.457247:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb87fb61000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790945420.457252:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1877942273590144:0@lo:38: 00000100:00100000:0.0:1790945420.457335:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7622:1877942273590784:0@lo:901: 00000100:00100000:0.0:1790945420.457363:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945420.457387:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b5669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945420.457501:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273590784 00000100:00100000:2.0:1790945420.457506:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273590784 00000100:00100000:2.0:1790945420.457548:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945420.457555:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7622:x1877942273590784:12345-0@lo:901: 00000100:00100000:2.0:1790945420.457911:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7622:x1877942273590784:12345-0@lo:901: Request processed in 356us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945420.457918:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790945420.458044:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790945420.458066:0:7622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86cad6300 x1877942273590784/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790945436 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945420.458076:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7622:1877942273590784:0@lo:901: 00000100:00100000:2.0:1790945420.459494:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273590656 00000100:00100000:2.0:1790945420.459505:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273590656 00000100:00100000:2.0:1790945420.459543:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790945420.459551:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7608:x1877942273590656:12345-0@lo:253: 20000000:01000000:2.0:1790945420.459585:0:5815:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790945420.459599:0:5815:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790945420.486839:0:5815:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790945420.486859:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790945420.486964:0:5840:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790945420.486969:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790945420.486989:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.487008:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb84167aa00/0xc5cf2c2a6a54f05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f058 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.487016:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.487056:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb84167aa00/0xc5cf2c2a6a54f05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f058 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945420.487084:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb84167aa00/0xc5cf2c2a6a54f05f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f058 expref: 14 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945420.487098:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5840:1877942273590912:0@lo:104: 00000100:00100000:3.0:1790945420.487172:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945420.487218:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881633840 going to sleep for 11 seconds 00000100:00100000:0.0:1790945420.487334:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273590912 00000100:00100000:0.0:1790945420.487342:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273590912 00000100:00100000:0.0:1790945420.487401:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790945420.487411:0:5807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5840:x1877942273590912:12345-0@lo:104: 00010000:00010000:0.0:1790945420.487423:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f05f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.487473:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790945420.487492:0:5807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:5840:x1877942273590912:12345-0@lo:104: Request processed in 83us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945420.487499:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1790945420.487518:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945420.487523:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f05f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.487531:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030e00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1790945420.487535:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f05f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.487543:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f05f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945420.487550:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f05f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945420.487557:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945420.487582:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f05f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.487589:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945420.487604:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f05f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.487611:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb840030e00/0xc5cf2c2a6a54f058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f05f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945420.487627:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945420.487629:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945420.487631:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945420.487648:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273591040:0@lo:103: 00000100:00100000:0.0:1790945420.487701:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945420.487919:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5840:1877942273590912:0@lo:104: 00010000:00010000:3.0:1790945420.487936:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945420.491493:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273591040 00000100:00100000:2.0:1790945420.491508:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273591040 00010000:00010000:2.0:1790945420.491544:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb84167aa00/0xc5cf2c2a6a54f05f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f058 expref: 15 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945420.491584:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790945420.491593:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:3294:x1877942273591040:12345-0@lo:103: 00010000:00010000:2.0:1790945420.491607:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945420.491613:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb84167aa00/0xc5cf2c2a6a54f05f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f058 expref: 15 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.491624:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb84167aa00/0xc5cf2c2a6a54f05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f058 expref: 15 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.491642:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167aa00/0xc5cf2c2a6a54f05f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f058 expref: 15 pid: 5818 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.491700:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.491710:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790945420.491727:0:5808:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004758423s 00010000:00010000:2.0:1790945420.491732:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.491751:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.491758:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.491765:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.491772:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8414a6800 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945420.491776:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.491784:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.491798:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945420.491808:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790945420.492104:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.492113:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945420.492120:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f10e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945420.492231:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:3294:x1877942273591040:12345-0@lo:103: Request processed in 638us (4527us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945420.492240:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790945420.492453:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273591040:0@lo:103: 00000100:00100000:1.0:1790945420.497538:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:7608:x1877942273590656:12345-0@lo:253: Request processed in 37980us (40911us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945420.497553:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790945420.497632:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7608:1877942273590656:0@lo:253: 10000000:01000000:2.0:1790945420.497647:0:7608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790945420.497651:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790945420.497653:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790945420.497654:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790945420.497688:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790945420.497690:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790945420.497691:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790945420.497693:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790945420.497694:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790945420.497696:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790945420.497698:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790945420.497699:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790945420.497714:0:7608:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790945420.506815:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790945420.507023:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790945420.507891:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790945420.508046:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790945420.508441:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790945420.508776:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790945420.510001:0:7608:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1790945420.742891:0:7608:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790945420.742899:0:7608:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790945420.742931:0:7608:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790945420.742989:0:7608:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790945420.743004:0:7608:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790945420.743030:0:7608:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1790945421.021452:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945422.062767:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945422.626975:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273591168:0@lo:13: 00000100:00100000:3.0:1790945422.627045:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945422.629432:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273591168 00000100:00100000:2.0:1790945422.629447:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273591168 00000100:00100000:2.0:1790945422.629513:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790945422.629523:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273591168:12345-0@lo:13: 00002000:00000024:2.0:1790945422.629560:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790945422.632726:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945422.636461:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273591168:12345-0@lo:13: Request processed in 6930us (9406us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945422.636476:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790945422.640244:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86cad4e00 x1877942273591168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945422.640270:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273591168:0@lo:13: 00010000:00010000:0.0:1790945423.067850:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945424.094726:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945425.124300:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945425.694820:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273591424:0@lo:400: 00000100:00100000:3.0:1790945425.694915:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945425.694985:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790945425.694992:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273591296:0@lo:400: 00000100:00100000:3.0:1790945425.695027:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945425.695050:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273591808:0@lo:400: 00000100:00100000:3.0:1790945425.695074:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945425.695113:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273591552:0@lo:400: 00000100:00100000:3.0:1790945425.695140:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945425.695160:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945425.695166:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273591680:0@lo:400: 00000100:00100000:3.0:1790945425.695208:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945425.695247:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273591424 00000100:00100000:3.0:1790945425.695258:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273591424 00000100:00100000:3.0:1790945425.695311:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273591808 00000100:00100000:3.0:1790945425.695315:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273591808 00000100:00100000:3.0:1790945425.695340:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273591552 00000100:00100000:3.0:1790945425.695343:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273591552 00000100:00100000:3.0:1790945425.695363:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790945425.695373:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273591424:12345-0@lo:400: 00000100:00100000:3.0:1790945425.695434:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273591424:12345-0@lo:400: Request processed in 62us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945425.695441:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790945425.695462:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790945425.695468:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273591808:12345-0@lo:400: 00000100:00100000:3.0:1790945425.695496:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273591808:12345-0@lo:400: Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945425.695502:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790945425.695513:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790945425.695520:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273591552:12345-0@lo:400: 00000100:00100000:3.0:1790945425.695552:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273591552:12345-0@lo:400: Request processed in 33us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945425.695558:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790945425.695578:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273591296 00000100:00100000:3.0:1790945425.695581:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273591296 00000100:00100000:3.0:1790945425.695604:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790945425.695611:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:3293:x1877942273591296:12345-0@lo:400: 00000100:00100000:3.0:1790945425.695641:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:3293:x1877942273591296:12345-0@lo:400: Request processed in 30us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945425.695654:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1790945425.695730:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945425.695763:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273591296:0@lo:400: 00010000:00080000:3.0:1790945425.695779:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86c930000 x1877942273591808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945425.695792:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273591808:0@lo:400: 00010000:00080000:3.0:1790945425.695803:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86c931880 x1877942273591424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945425.695810:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273591424:0@lo:400: 00010000:00080000:3.0:1790945425.695860:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86c930700 x1877942273591552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945425.695869:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273591552:0@lo:400: 00000100:00100000:1.0:1790945425.696050:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273591680 00000100:00100000:1.0:1790945425.696055:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273591680 00000100:00100000:1.0:1790945425.696104:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790945425.696112:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273591680:12345-0@lo:400: 00000100:00100000:1.0:1790945425.696162:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273591680:12345-0@lo:400: Request processed in 52us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945425.696168:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1790945425.696186:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945425.696206:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86c930380 x1877942273591680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945425.696214:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273591680:0@lo:400: 00010000:00010000:1.0:1790945426.141372:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945427.163950:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790945427.231931:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790945427.231944:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bb8654d2800 from 30 10000000:01000000:1.0:1790945427.231952:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790945427.232018:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945427.232032:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945427.232046:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945427.232088:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273591936:0@lo:101: 00000100:00100000:1.0:1790945427.232199:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945427.232290:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb852096d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945427.232743:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273591936 00000100:00100000:0.0:1790945427.232754:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273591936 00000100:00100000:0.0:1790945427.232830:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790945427.232840:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:5820:x1877942273591936:12345-0@lo:101: 00010000:00010000:0.0:1790945427.232859:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945427.232876:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb840030e00/0xc5cf2c2a6a54f11c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f115 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945427.232906:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb840030e00/0xc5cf2c2a6a54f11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f115 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945427.232918:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb840030e00/0xc5cf2c2a6a54f11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f115 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945427.232928:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030e00, rc 0) 00000100:00100000:0.0:1790945427.232996:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273591936:12345-0@lo:101: Request processed in 156us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945427.233004:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790945427.233134:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273591936:0@lo:101: 00010000:00010000:2.0:1790945427.233169:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f11c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945427.233179:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f11c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945427.233264:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273592064:0@lo:501: 00000100:00100000:2.0:1790945427.233295:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945427.233325:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843003540 going to sleep for 11 seconds 00000100:00100000:0.0:1790945427.233550:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273592064 00000100:00100000:0.0:1790945427.233554:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273592064 00000100:00100000:0.0:1790945427.233585:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790945427.233592:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273592064:12345-0@lo:501: 00000100:00100000:0.0:1790945427.234042:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273592064:12345-0@lo:501: Request processed in 449us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945427.234060:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790945427.235943:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273592064:0@lo:501: 00000100:00100000:2.0:1790945427.236020:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273592192:0@lo:503: 00000100:00100000:2.0:1790945427.236126:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945427.236185:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843003540 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.236687:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273592192 00000100:00100000:3.0:1790945427.236697:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273592192 00000100:00100000:3.0:1790945427.236756:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790945427.236765:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273592192:12345-0@lo:503: 00000100:00100000:3.0:1790945427.237235:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273592192:12345-0@lo:503: Request processed in 469us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.237244:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790945427.237566:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273592192:0@lo:503: 00000100:00100000:3.0:1790945427.239114:0:7911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7911:1877942273592320:0@lo:502: 00000100:00100000:3.0:1790945427.239209:0:7911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945427.239273:0:7911:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb844ec4180 going to sleep for 11 seconds 00000100:00100000:0.0:1790945427.239415:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273592320 00000100:00100000:0.0:1790945427.239426:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273592320 00000100:00100000:0.0:1790945427.239482:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790945427.239494:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7911:x1877942273592320:12345-0@lo:502: 00000100:00100000:0.0:1790945427.239890:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7911:x1877942273592320:12345-0@lo:502: Request processed in 398us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945427.239899:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790945427.243733:0:7911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7911:1877942273592320:0@lo:502: 00000100:00100000:3.0:1790945427.243913:0:7911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7911:1877942273592448:0@lo:502: 00000100:00100000:3.0:1790945427.244009:0:7911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945427.244057:0:7911:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb844ec4180 going to sleep for 11 seconds 00000100:00100000:0.0:1790945427.244151:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273592448 00000100:00100000:0.0:1790945427.244161:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273592448 00000100:00100000:0.0:1790945427.244223:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790945427.244234:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7911:x1877942273592448:12345-0@lo:502: 00000100:00100000:0.0:1790945427.244559:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:7911:x1877942273592448:12345-0@lo:502: Request processed in 327us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945427.244569:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790945427.245023:0:7911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7911:1877942273592448:0@lo:502: 00000040:00080000:3.0:1790945427.245086:0:7911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1790945427.245447:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1790945427.245480:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790945427.245494:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f11c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945427.245508:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f11c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945427.245520:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790945427.245523:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1790945427.245526:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790945427.245565:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945427.245590:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945427.245601:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945427.245620:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273592576:0@lo:101: 00000100:00100000:0.0:1790945427.245702:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945427.245738:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.245848:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273592576 00000100:00100000:3.0:1790945427.245854:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273592576 00000100:00100000:3.0:1790945427.245893:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790945427.245903:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273592576:12345-0@lo:101: 00010000:00010000:3.0:1790945427.245918:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945427.245933:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f12a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f123 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.245960:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f123 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.245972:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f123 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.245981:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8414a7e00, rc 0) 00000100:00100000:3.0:1790945427.246015:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273592576:12345-0@lo:101: Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.246022:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790945427.247773:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273592576:0@lo:101: 00010000:00010000:0.0:1790945427.247814:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f12a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945427.247829:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f12a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945427.247929:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273592704:0@lo:501: 00000100:00100000:0.0:1790945427.247995:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945427.248043:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.248139:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273592704 00000100:00100000:3.0:1790945427.248147:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273592704 00000100:00100000:3.0:1790945427.248197:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790945427.248207:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273592704:12345-0@lo:501: 00000100:00100000:3.0:1790945427.248574:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273592704:12345-0@lo:501: Request processed in 366us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.248593:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790945427.248826:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273592704:0@lo:501: 00000100:00100000:2.0:1790945427.248874:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273592832:0@lo:503: 00000100:00100000:2.0:1790945427.248922:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945427.248953:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843003540 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.249035:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273592832 00000100:00100000:3.0:1790945427.249040:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273592832 00000100:00100000:3.0:1790945427.249066:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790945427.249072:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273592832:12345-0@lo:503: 00000100:00100000:3.0:1790945427.249632:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273592832:12345-0@lo:503: Request processed in 556us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.249640:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790945427.250998:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273592832:0@lo:503: 00000100:00100000:2.0:1790945427.253200:0:7912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7912:1877942273592960:0@lo:502: 00000100:00100000:2.0:1790945427.253338:0:7912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945427.253399:0:7912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843003480 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.253532:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273592960 00000100:00100000:3.0:1790945427.253542:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273592960 00000100:00100000:3.0:1790945427.253601:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790945427.253613:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:7912:x1877942273592960:12345-0@lo:502: 00000100:00100000:3.0:1790945427.253984:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:7912:x1877942273592960:12345-0@lo:502: Request processed in 372us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.253993:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790945427.254423:0:7912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7912:1877942273592960:0@lo:502: 00000020:01000000:0.0:1790945427.254474:0:7912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945427.254485:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945427.254488:0:7912:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790945427.254494:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790945427.254496:0:7912:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790945427.254520:0:7912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7912:1877942273593088:0@lo:502: 00000100:00100000:0.0:1790945427.254562:0:7912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945427.254642:0:7912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.260856:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273593088 00000100:00100000:3.0:1790945427.260878:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273593088 00000100:00100000:2.0:1790945427.270303:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790945427.270324:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:7912:x1877942273593088:12345-0@lo:502: 00000100:00100000:2.0:1790945427.270737:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:7912:x1877942273593088:12345-0@lo:502: Request processed in 417us (16173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945427.270747:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790945427.270963:0:7912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7912:1877942273593088:0@lo:502: 00000020:01000000:1.0:1790945427.271030:0:7912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945427.271040:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945427.271043:0:7912:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790945427.271048:0:7912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1790945427.271461:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1790945427.271488:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790945427.271502:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f12a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945427.271516:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f12a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945427.271529:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790945427.271542:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bb845514800 from 30 10000000:01000000:2.0:1790945427.271547:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945427.271591:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945427.271601:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945427.271613:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945427.271638:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273593216:0@lo:101: 00000100:00100000:2.0:1790945427.275553:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945427.275626:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843003240 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.275834:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273593216 00000100:00100000:3.0:1790945427.275847:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273593216 00000100:00100000:3.0:1790945427.275905:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790945427.275916:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273593216:12345-0@lo:101: 00010000:00010000:3.0:1790945427.275940:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945427.275964:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f138 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f131 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.276000:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f131 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.276039:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f131 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.276049:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8414a7c00, rc 0) 00000100:00100000:3.0:1790945427.276122:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273593216:12345-0@lo:101: Request processed in 207us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.276130:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790945427.276225:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273593216:0@lo:101: 00010000:00010000:1.0:1790945427.276248:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f138 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945427.276269:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f138 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945427.276359:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273593344:0@lo:501: 00000100:00100000:1.0:1790945427.276405:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945427.276437:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8520969c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945427.276693:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273593344 00000100:00100000:2.0:1790945427.276698:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273593344 00000100:00100000:2.0:1790945427.276731:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790945427.276739:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273593344:12345-0@lo:501: 00000100:00100000:2.0:1790945427.277092:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273593344:12345-0@lo:501: Request processed in 353us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945427.277101:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790945427.277137:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273593344:0@lo:501: 00000100:00100000:2.0:1790945427.277176:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273593472:0@lo:503: 00000100:00100000:2.0:1790945427.277222:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945427.277233:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843003240 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.277749:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273593472 00000100:00100000:3.0:1790945427.277758:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273593472 00000100:00100000:3.0:1790945427.277790:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790945427.277799:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273593472:12345-0@lo:503: 00000100:00100000:3.0:1790945427.278013:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273593472:12345-0@lo:503: Request processed in 214us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.278021:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790945427.278083:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273593472:0@lo:503: 00000100:00100000:3.0:1790945427.278361:0:7913:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7913:1877942273593600:0@lo:502: 00000100:00100000:3.0:1790945427.278406:0:7913:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945427.278428:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273593600 00000100:00100000:3.0:1790945427.278433:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273593600 00000100:00100000:3.0:1790945427.278451:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790945427.278457:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:7913:x1877942273593600:12345-0@lo:502: 00000100:00100000:3.0:1790945427.278636:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:7913:x1877942273593600:12345-0@lo:502: Request processed in 178us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.278643:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790945427.278717:0:7913:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843003240 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.278739:0:7913:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7913:1877942273593600:0@lo:502: 00000100:00100000:3.0:1790945427.278808:0:7913:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7913:1877942273593728:0@lo:502: 00000100:00100000:3.0:1790945427.278844:0:7913:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945427.278863:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273593728 00000100:00100000:3.0:1790945427.278867:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273593728 00000100:00100000:3.0:1790945427.278883:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790945427.278888:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:7913:x1877942273593728:12345-0@lo:502: 00000100:00100000:3.0:1790945427.279007:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:7913:x1877942273593728:12345-0@lo:502: Request processed in 118us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.279014:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790945427.279041:0:7913:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8430c8840 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.279053:0:7913:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7913:1877942273593728:0@lo:502: 00000040:00080000:3.0:1790945427.279091:0:7913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790945427.279160:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790945427.279189:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790945427.279203:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f138 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.279218:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f138 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945427.279231:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790945427.279234:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bb845514800 from 5 10000000:01000000:3.0:1790945427.279237:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790945427.279276:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.279286:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.279306:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945427.279319:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273593856:0@lo:101: 00000100:00100000:3.0:1790945427.279348:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945427.279363:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8430c8840 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.279375:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273593856 00000100:00100000:3.0:1790945427.279379:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273593856 00000100:00100000:3.0:1790945427.279395:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790945427.279401:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273593856:12345-0@lo:101: 00010000:00010000:3.0:1790945427.279411:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945427.279427:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8414a7800/0xc5cf2c2a6a54f146 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f13f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.279451:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8414a7800/0xc5cf2c2a6a54f146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f13f expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.279464:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8414a7800/0xc5cf2c2a6a54f146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f13f expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.279475:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8414a7800, rc 0) 00000100:00100000:3.0:1790945427.279504:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273593856:12345-0@lo:101: Request processed in 102us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.279510:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790945427.279539:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273593856:0@lo:101: 00010000:00010000:3.0:1790945427.279553:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.279573:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945427.279623:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273593984:0@lo:256: 00000100:00100000:3.0:1790945427.279691:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945427.279713:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8430c8840 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.279724:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273593984 00000100:00100000:3.0:1790945427.279727:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273593984 00000100:00100000:3.0:1790945427.279745:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790945427.279751:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273593984:12345-0@lo:256: 20000000:01000000:3.0:1790945427.279766:0:5818:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790945427.279786:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790945427.279790:0:5818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1790945427.279873:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273593984:12345-0@lo:256: Request processed in 121us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.279880:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790945427.279908:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273593984:0@lo:256: 10000000:01000000:3.0:1790945427.279953:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790945427.279959:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.279968:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945427.279976:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790945427.279978:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1790945427.279981:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790945427.280004:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.280012:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.280021:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945427.280033:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273594112:0@lo:101: 00000100:00100000:3.0:1790945427.280058:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945427.280070:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.280095:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273594112 00000100:00100000:3.0:1790945427.280099:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273594112 00000100:00100000:3.0:1790945427.280117:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790945427.280124:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273594112:12345-0@lo:101: 00010000:00010000:3.0:1790945427.280131:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945427.280141:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f14d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.280156:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f14d expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.280164:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f14d expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.280171:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8414a6800, rc 0) 00000100:00100000:3.0:1790945427.280199:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273594112:12345-0@lo:101: Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.280205:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790945427.280240:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273594112:0@lo:101: 00010000:00010000:3.0:1790945427.280250:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f154 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945427.280258:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f154 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945427.280305:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273594240:0@lo:501: 00000100:00100000:3.0:1790945427.280332:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945427.280345:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.280355:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273594240 00000100:00100000:3.0:1790945427.280358:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273594240 00000100:00100000:3.0:1790945427.280374:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790945427.280380:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273594240:12345-0@lo:501: 00000100:00100000:3.0:1790945427.280697:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273594240:12345-0@lo:501: Request processed in 317us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.280704:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790945427.280732:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273594240:0@lo:501: 00000100:00100000:3.0:1790945427.280762:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273594368:0@lo:503: 00000100:00100000:3.0:1790945427.280801:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945427.280821:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.280830:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273594368 00000100:00100000:3.0:1790945427.280834:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273594368 00000100:00100000:3.0:1790945427.280848:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790945427.280853:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273594368:12345-0@lo:503: 00000100:00100000:3.0:1790945427.289426:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273594368:12345-0@lo:503: Request processed in 8561us (8613us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.289462:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790945427.289558:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273594368:0@lo:503: 00000100:00100000:3.0:1790945427.290744:0:7915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7915:1877942273594496:0@lo:502: 00000100:00100000:3.0:1790945427.290825:0:7915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945427.290873:0:7915:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f000 going to sleep for 11 seconds 00000100:00100000:1.0:1790945427.290936:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273594496 00000100:00100000:1.0:1790945427.290946:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273594496 00000100:00100000:1.0:1790945427.291001:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790945427.291012:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:7915:x1877942273594496:12345-0@lo:502: 00000100:00100000:1.0:1790945427.291579:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:7915:x1877942273594496:12345-0@lo:502: Request processed in 567us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945427.291589:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790945427.291721:0:7915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7915:1877942273594496:0@lo:502: 00000020:01000000:3.0:1790945427.291768:0:7915:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790945427.291778:0:7915:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790945427.291787:0:7915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945427.291789:0:7915:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790945427.291794:0:7915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790945427.291798:0:7915:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:3.0:1790945427.291824:0:7915:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790945427.291827:0:7915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790945427.291845:0:7915:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bb865fe99c0) 00000020:00000080:3.0:1790945427.291872:0:7915:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1790945427.291879:0:7915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790945427.291986:0:7915:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790945427.291992:0:7915:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790945427.292001:0:7915:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a54f162 00010000:00080000:3.0:1790945427.292037:0:7915:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb865e70000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:3.0:1790945427.293608:0:7915:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1790945427.294047:0:7915:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1790945427.294066:0:7915:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790945427.295903:0:7915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790945427.296164:0:7915:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790945427.296221:0:7915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1790945427.298561:0:7915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1790945427.300628:0:7917:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790945427.300637:0:7917:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790945427.304348:0:7915:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790945427.304370:0:7915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790945427.304422:0:7915:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790945427.304454:0:7915:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5cf2c2a6a54f169 00000100:00080000:0.0:1790945427.304468:0:7915:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790945427.304484:0:7915:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bb865e70000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1790945427.304533:0:7915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb86cad5c00 x1877942273594624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790945427.304610:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273594624:0@lo:8: 00000100:00100000:3.0:1790945427.304738:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790945427.304820:0:7915:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790945427.304891:0:7915:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945427.304895:0:7915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945427.304898:0:7915:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790945427.304901:0:7915:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945427.304906:0:7915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945427.304907:0:7915:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790945427.304910:0:7915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790945427.304912:0:7915:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790945427.304941:0:7915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7915:1877942273594752:0@lo:502: 00000100:00100000:0.0:1790945427.304997:0:7915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945427.305015:0:7915:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc6000 going to sleep for 11 seconds 00000100:00100000:0.0:1790945427.308481:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273594624 00000100:00100000:0.0:1790945427.308499:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273594624 00000100:00100000:0.0:1790945427.308549:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790945427.308559:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3291:x1877942273594624:12345-0@lo:8: 00010000:00080000:0.0:1790945427.308596:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1790945427.308634:0:6673:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5cf2c2a6a54f170 00002000:00100000:0.0:1790945427.308678:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bb87b4b9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790945427.308683:0:6673:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1790945427.308688:0:6673:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1790945427.308840:0:6673:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790945427.309036:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790945427.309069:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9bb87b4bd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790945427.309391:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273595008:0@lo:400: 00000100:00100000:1.0:1790945427.309443:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945427.309495:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945427.309501:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273595136:0@lo:400: 00000100:00100000:1.0:1790945427.309527:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945427.309556:0:6672:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790945427.309565:0:6672:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1790945427.309581:0:6670:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790945427.309587:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273595136 00000100:00100000:1.0:1790945427.309592:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273595136 00000100:00100000:1.0:1790945427.309631:0:6670:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790945427.309638:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790945427.309645:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273595136:12345-0@lo:400: 00000100:00100000:1.0:1790945427.309707:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273595136:12345-0@lo:400: Request processed in 61us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945427.309714:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790945427.309735:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790945427.309762:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86cad6d80 x1877942273595136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945427.309797:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273595136:0@lo:400: 00000100:00100000:2.0:1790945427.310503:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273594880:0@lo:400: 00000100:00100000:2.0:1790945427.310560:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945427.310598:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790945427.310612:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273595264:0@lo:400: 00000100:00100000:2.0:1790945427.310640:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945427.311403:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273594752 00000100:00100000:3.0:1790945427.311415:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273594752 00000100:00100000:3.0:1790945427.311475:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790945427.311485:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:7915:x1877942273594752:12345-0@lo:502: 00000100:00100000:3.0:1790945427.311846:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:7915:x1877942273594752:12345-0@lo:502: Request processed in 362us (6847us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.311853:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790945427.311901:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273595008 00000100:00100000:3.0:1790945427.311906:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273595008 00000100:00100000:3.0:1790945427.311941:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273594880 00000100:00100000:3.0:1790945427.311944:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273594880 00000100:00100000:3.0:1790945427.311955:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273595264 00000100:00100000:3.0:1790945427.311957:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273595264 00000100:00100000:3.0:1790945427.311972:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790945427.311978:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273595008:12345-0@lo:400: 00000100:00100000:3.0:1790945427.312026:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273595008:12345-0@lo:400: Request processed in 48us (2583us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.312032:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790945427.312044:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790945427.312049:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273594880:12345-0@lo:400: 00000100:00100000:3.0:1790945427.312088:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273594880:12345-0@lo:400: Request processed in 26us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.312094:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790945427.312109:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790945427.312116:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273595264:12345-0@lo:400: 00000100:00100000:3.0:1790945427.312149:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273595264:12345-0@lo:400: Request processed in 29us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945427.312163:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1790945427.312192:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790945427.312233:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86cad7800 x1877942273595008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945427.312250:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273595008:0@lo:400: 00000100:00100000:0.0:1790945427.312359:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3291:x1877942273594624:12345-0@lo:8: Request processed in 3797us (7619us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945427.312370:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790945427.312417:0:7915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:7915:1877942273594752:0@lo:502: 00000020:01000000:0.0:1790945427.312468:0:7915:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945427.312478:0:7915:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945427.312481:0:7915:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790945427.312487:0:7915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1790945427.312782:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1790945427.312805:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790945427.312819:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f154 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945427.312837:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f154 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945427.312849:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790945427.312853:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bb8656099c0 from 1 10000000:01000000:2.0:1790945427.312857:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790945427.313262:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945427.313273:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945427.313283:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945427.313309:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273595392:0@lo:101: 00000100:00100000:2.0:1790945427.313374:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945427.313466:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8738953c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945427.313545:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273595392 00000100:00100000:0.0:1790945427.313552:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273595392 00000100:00100000:0.0:1790945427.313643:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790945427.313670:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273595392:12345-0@lo:101: 00010000:00010000:0.0:1790945427.313686:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945427.313702:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb840031200/0xc5cf2c2a6a54f17e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f177 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1790945427.313717:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86cad4380 x1877942273595264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945427.313730:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273595264:0@lo:400: 00010000:00010000:0.0:1790945427.313731:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb840031200/0xc5cf2c2a6a54f17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f177 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945427.313743:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb840031200/0xc5cf2c2a6a54f17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f177 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1790945427.313744:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86cad7b80 x1877942273594880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945427.313753:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273594880:0@lo:400: 00010000:00010000:0.0:1790945427.313753:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840031200, rc 0) 00000100:00100000:0.0:1790945427.313805:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273595392:12345-0@lo:101: Request processed in 154us (430us total) trans 0 rc 0/0 00010000:00080000:3.0:1790945427.313806:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86cad5c00 x1877942273594624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790945437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945427.313812:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790945427.313816:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790945427.313836:0:3291:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790945427.313847:0:3291:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790945427.313853:0:3291:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790945427.313857:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb865e70000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790945427.313869:0:3291:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790945427.313876:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273594624:0@lo:8: 00000100:00100000:0.0:1790945427.314025:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273595392:0@lo:101: 00010000:00010000:0.0:1790945427.314042:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f17e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945427.314052:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f17e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945427.314124:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273595520:0@lo:501: 00000100:00100000:0.0:1790945427.314152:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945427.314172:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc6000 going to sleep for 11 seconds 00000004:00080000:0.0:1790945427.314187:0:7917:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1790945427.314191:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273595520 00000100:00100000:1.0:1790945427.314196:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273595520 00000100:00100000:1.0:1790945427.314231:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790945427.314238:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273595520:12345-0@lo:501: 00000004:00080000:0.0:1790945427.314380:0:7917:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 173109721816ns, next at 0ns, rc = 0 00000100:00100000:1.0:1790945427.314555:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273595520:12345-0@lo:501: Request processed in 317us (401us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790945427.314563:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790945427.314575:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273595520:0@lo:501: 10000000:01000000:0.0:1790945427.314603:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790945427.314610:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f17e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945427.314618:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f17e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790945427.406967:0:7918:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790945427.407009:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1877942273595776:0@lo:7: 00000100:00100000:3.0:1790945427.407913:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945427.408003:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb877a12600 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.408120:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273595648:0@lo:13: 00000100:00100000:3.0:1790945427.408156:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945427.408394:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273595776 00000100:00100000:2.0:1790945427.408407:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273595776 00000100:00100000:2.0:1790945427.408485:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790945427.408497:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7918:x1877942273595776:12345-0@lo:7: 00000100:00100000:0.0:1790945427.411019:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273595648 00000100:00100000:0.0:1790945427.411040:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273595648 00000100:00100000:0.0:1790945427.411124:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790945427.411137:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1877942273595648:12345-0@lo:13: 00002000:00000024:0.0:1790945427.411193:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1790945427.411323:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1877942273595648:12345-0@lo:13: Request processed in 189us (3166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945427.411331:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790945427.411397:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86c931880 x1877942273595648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945427.411423:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273595648:0@lo:13: 00000100:00080000:3.0:1790945427.419112:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1790945427.433611:0:6670:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1790945427.433629:0:6670:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1790945427.433806:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7918:x1877942273595776:12345-0@lo:7: Request processed in 25296us (25878us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945427.433827:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790945427.433963:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86c930000 x1877942273595776/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790945443 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945427.433983:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1877942273595776:0@lo:7: 00000004:00080000:3.0:1790945427.434005:0:7918:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1790945427.434149:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1877942273595904:0@lo:5: 00000100:00100000:3.0:1790945427.434197:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945427.434278:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273595904 00000100:00100000:3.0:1790945427.434320:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb877a12600 going to sleep for 11 seconds 00000100:00100000:2.0:1790945427.434338:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273595904 00000100:00100000:2.0:1790945427.434402:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790945427.434414:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7918:x1877942273595904:12345-0@lo:5: 00002000:00080000:2.0:1790945427.434448:0:6670:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790945427.434453:0:6670:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790945427.434789:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7918:x1877942273595904:12345-0@lo:5: Request processed in 376us (591us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790945427.435446:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790945427.448515:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86c930000 x1877942273595904/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790945443 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945427.448546:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1877942273595904:0@lo:5: 00000004:00080000:2.0:1790945427.448567:0:7918:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1790945427.448625:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1877942273596032:0@lo:700: 00000100:00100000:2.0:1790945427.448754:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945427.448815:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8738956c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945427.448844:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273596032 00000100:00100000:2.0:1790945427.448852:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273596032 00000100:00100000:2.0:1790945427.449110:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945427.449123:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7918:x1877942273596032:12345-0@lo:700: 00000100:00100000:2.0:1790945427.449266:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6679:1877942273596160:0@lo:700: 00000100:00100000:2.0:1790945427.449384:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945427.449418:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb873895540 going to sleep for 11 seconds 00000100:00100000:3.0:1790945427.450918:0:5830:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273596160 00000100:00100000:3.0:1790945427.450933:0:5830:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273596160 00000100:00100000:3.0:1790945427.451012:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945427.451123:0:5830:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6679:x1877942273596160:12345-0@lo:700: 00000004:00080000:0.0:1790945427.526314:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1790945427.607120:0:5830:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1790945427.618162:0:5830:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6679:x1877942273596160:12345-0@lo:700: Request processed in 167032us (168768us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945427.618180:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790945427.618372:0:6679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87acfc380 x1877942273596160/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790945443 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945427.618393:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6679:1877942273596160:0@lo:700: 40000000:02000000:2.0:1790945427.618413:0:6679:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:3.0:1790945427.727753:0:7627:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1790945427.727785:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1790945427.729416:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7918:x1877942273596032:12345-0@lo:700: Request processed in 280283us (280651us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945427.729435:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790945427.729462:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87b5c1880 x1877942273596032/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790945443 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945427.729478:0:7918:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790945427.729517:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1877942273596032:0@lo:700: 00000100:00100000:3.0:1790945427.741001:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273596288:0@lo:13: 00000100:00100000:3.0:1790945427.741115:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945427.741276:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273596288 00000100:00100000:0.0:1790945427.741716:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273596288 00000100:00100000:0.0:1790945427.741785:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790945427.741935:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273596288:12345-0@lo:13: 00002000:00000024:0.0:1790945427.741985:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945427.742057:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273596288:12345-0@lo:13: Request processed in 263us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945427.742069:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790945427.742148:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87acfc380 x1877942273596288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945427.742176:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273596288:0@lo:13: 00000004:02000040:3.0:1790945427.780712:0:7918:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1790945427.789918:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1877942273596416:0@lo:5: 00000100:00100000:3.0:1790945427.790041:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945427.790131:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273596416 00000100:00100000:3.0:1790945427.790137:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881633540 going to sleep for 11 seconds 00000100:00100000:1.0:1790945427.790142:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273596416 00000100:00100000:1.0:1790945427.790213:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790945427.790223:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7918:x1877942273596416:12345-0@lo:5: 00002000:00080000:2.0:1790945427.800236:0:6672:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1790945427.800284:0:6672:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1790945427.818226:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7918:x1877942273596416:12345-0@lo:5: Request processed in 27990us (28171us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790945427.818246:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790945427.818789:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86c930380 x1877942273596416/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790945443 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945427.818828:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1877942273596416:0@lo:5: 00000004:00080000:0.0:1790945427.818849:0:7918:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1790945428.187813:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790945428.327591:0:7979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790945429.213202:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945430.236817:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945431.259893:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945432.284949:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945432.347963:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273596800:0@lo:400: 00000100:00100000:2.0:1790945432.348070:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945432.348154:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790945432.348161:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273596672:0@lo:400: 00000100:00100000:2.0:1790945432.348184:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945432.348205:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273597184:0@lo:400: 00000100:00100000:2.0:1790945432.348244:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945432.348295:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273596800 00000100:00100000:2.0:1790945432.348305:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273596800 00000100:00100000:2.0:1790945432.348383:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273596672 00000100:00100000:2.0:1790945432.348387:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273596672 00000100:00100000:2.0:1790945432.348419:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790945432.348430:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273596800:12345-0@lo:400: 00000100:00100000:2.0:1790945432.348497:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273596800:12345-0@lo:400: Request processed in 68us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945432.348518:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790945432.348542:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790945432.348549:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273596672:12345-0@lo:400: 00000100:00100000:2.0:1790945432.348583:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273596672:12345-0@lo:400: Request processed in 34us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945432.348589:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790945432.348619:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273597184 00000100:00100000:2.0:1790945432.348624:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273597184 00000100:00100000:2.0:1790945432.348697:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945432.348705:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273597184:12345-0@lo:400: 00000100:00100000:2.0:1790945432.348740:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273597184:12345-0@lo:400: Request processed in 36us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945432.348747:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1790945432.348770:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945432.348775:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790945432.348822:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87acfe300 x1877942273596672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945432.348855:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273596672:0@lo:400: 00010000:00080000:2.0:1790945432.348883:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87acfce00 x1877942273597184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945432.348892:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273597184:0@lo:400: 00010000:00080000:2.0:1790945432.348903:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87acfd500 x1877942273596800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945432.348911:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273596800:0@lo:400: 00000100:00100000:0.0:1790945432.349090:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273596544:0@lo:400: 00000100:00100000:0.0:1790945432.349153:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945432.349205:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273597056:0@lo:400: 00000100:00100000:0.0:1790945432.349233:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945432.349270:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945432.349279:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273596928:0@lo:400: 00000100:00100000:0.0:1790945432.349313:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945432.349370:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273596928 00000100:00100000:0.0:1790945432.349376:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273596928 00000100:00100000:0.0:1790945432.349418:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790945432.349427:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273596928:12345-0@lo:400: 00000100:00100000:0.0:1790945432.349482:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273596928:12345-0@lo:400: Request processed in 57us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945432.349490:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790945432.349520:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87acfca80 x1877942273596928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945432.349532:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273596928:0@lo:400: 00000100:00100000:2.0:1790945432.349649:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273596544 00000100:00100000:2.0:1790945432.349698:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273596544 00000100:00100000:2.0:1790945432.349737:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790945432.349746:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273596544:12345-0@lo:400: 00000100:00100000:2.0:1790945432.349809:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273596544:12345-0@lo:400: Request processed in 65us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945432.349816:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1790945432.349852:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945432.349863:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273597056 00000100:00100000:2.0:1790945432.349867:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273597056 00000100:00100000:2.0:1790945432.349909:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790945432.349917:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273597056:12345-0@lo:400: 00000100:00100000:2.0:1790945432.349956:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273597056:12345-0@lo:400: Request processed in 41us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945432.349963:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1790945432.349979:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945432.350322:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273596544:0@lo:400: 00010000:00080000:0.0:1790945432.350337:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87acfe680 x1877942273597056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945432.350345:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273597056:0@lo:400: 00000100:00100000:1.0:1790945432.876937:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273597312:0@lo:13: 00000100:00100000:1.0:1790945432.877008:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945432.877084:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273597440:0@lo:13: 00000100:00100000:1.0:1790945432.877111:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945432.883215:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273597312 00000100:00100000:0.0:1790945432.883230:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273597312 00000100:00100000:0.0:1790945432.883277:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273597440 00000100:00100000:0.0:1790945432.883282:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273597440 00000100:00100000:0.0:1790945432.883300:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790945432.883308:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273597312:12345-0@lo:13: 00002000:00000024:0.0:1790945432.883339:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945432.883416:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273597312:12345-0@lo:13: Request processed in 109us (6408us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945432.883423:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790945432.883440:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790945432.883445:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273597440:12345-0@lo:13: 00002000:00000024:0.0:1790945432.883462:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945432.883503:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273597440:12345-0@lo:13: Request processed in 48us (6381us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945432.883509:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1790945432.890291:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb872fed880 x1877942273597440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945432.890317:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273597440:0@lo:13: 00010000:00080000:2.0:1790945432.890363:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb872fec380 x1877942273597312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945432.890377:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273597312:0@lo:13: 00000001:00080000:3.0:1790945432.990355:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1790945433.308964:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945434.332868:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945434.521504:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945434.521564:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254698624 00000100:00100000:3.0:1790945434.521575:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254698624 00000100:00100000:3.0:1790945434.521629:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 113 00000100:00100000:3.0:1790945434.521639:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2369:x1877942254698624:12345-192.168.202.48@tcp:250: 00010000:00080000:3.0:1790945434.522455:0:5818:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from bee3b157-ad31-4030-99ec-031c727e7689@192.168.202.48@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:3.0:1790945434.522485:0:5818:0:(genops.c:1384:class_connect()) connect: client bee3b157-ad31-4030-99ec-031c727e7689, cookie 0xc5cf2c2a6a54f185 00000100:00080000:3.0:1790945434.522625:0:5818:0:(import.c:65:import_set_state_nolock()) ffff9bb865e73800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790945434.522974:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+5:2369:x1877942254698624:12345-192.168.202.48@tcp:250: Request processed in 1334us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945434.522985:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 113 00000100:00100000:1.0:1790945434.527291:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945434.527414:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254698752 00000100:00100000:0.0:1790945434.527425:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254698752 00000100:00100000:0.0:1790945434.527478:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 114 00000100:00100000:0.0:1790945434.527488:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+5:5601:x1877942254698752:12345-192.168.202.48@tcp:101: 00010000:00010000:0.0:1790945434.527505:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945434.527523:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb840030600/0xc5cf2c2a6a54f18c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8003 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945434.527552:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb840030600/0xc5cf2c2a6a54f18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8003 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945434.527563:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb840030600/0xc5cf2c2a6a54f18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8003 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945434.527587:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030600, rc 0) 00000100:00100000:0.0:1790945434.527650:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+6:5601:x1877942254698752:12345-192.168.202.48@tcp:101: Request processed in 163us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945434.527676:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 114 00000100:00100000:3.0:1790945434.536847:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945434.536931:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254698880 00000100:00100000:0.0:1790945434.536941:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254698880 00000100:00100000:0.0:1790945434.536996:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 115 00000100:00100000:0.0:1790945434.537014:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+6:5601:x1877942254698880:12345-192.168.202.48@tcp:501: 00000100:00100000:0.0:1790945434.537319:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+6:5601:x1877942254698880:12345-192.168.202.48@tcp:501: Request processed in 313us (479us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790945434.537327:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 115 00000100:00100000:2.0:1790945434.545322:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945434.545397:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254699008 00000100:00100000:3.0:1790945434.545408:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254699008 00000100:00100000:3.0:1790945434.545463:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 116 00000100:00100000:3.0:1790945434.545472:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+6:5601:x1877942254699008:12345-192.168.202.48@tcp:101: 00010000:00010000:3.0:1790945434.545489:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945434.545508:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8821c4000/0xc5cf2c2a6a54f193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c800a expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945434.545535:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c4000/0xc5cf2c2a6a54f193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c800a expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945434.545565:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8821c4000/0xc5cf2c2a6a54f193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c800a expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945434.545574:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4000, rc 0) 00000100:00100000:3.0:1790945434.545636:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+7:5601:x1877942254699008:12345-192.168.202.48@tcp:101: Request processed in 164us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945434.545644:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 116 00000100:00100000:3.0:1790945434.548133:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945434.548185:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254699136 00000100:00100000:3.0:1790945434.548206:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254699136 00000100:00100000:3.0:1790945434.548259:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 117 00000100:00100000:3.0:1790945434.548269:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+7:5601:x1877942254699136:12345-192.168.202.48@tcp:501: 00000100:00100000:3.0:1790945434.548542:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+8:5601:x1877942254699136:12345-192.168.202.48@tcp:501: Request processed in 273us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945434.548551:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 117 00000100:00100000:3.0:1790945434.550779:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945434.551071:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254699264 00000100:00100000:3.0:1790945434.551080:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254699264 00000100:00100000:3.0:1790945434.551121:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 118 00000100:00100000:3.0:1790945434.551130:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+8:5601:x1877942254699264:12345-192.168.202.48@tcp:503: 00000100:00100000:3.0:1790945434.551397:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+8:5601:x1877942254699264:12345-192.168.202.48@tcp:503: Request processed in 267us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945434.551406:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 118 00000100:00100000:1.0:1790945434.564394:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945434.564554:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254699392 00000100:00100000:3.0:1790945434.564565:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254699392 00000100:00100000:3.0:1790945434.564630:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 119 00000100:00100000:3.0:1790945434.564640:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+8:5620:x1877942254699392:12345-192.168.202.48@tcp:502: 00000100:00100000:3.0:1790945434.564963:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+8:5620:x1877942254699392:12345-192.168.202.48@tcp:502: Request processed in 323us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945434.564971:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 119 00000100:00100000:3.0:1790945434.598433:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945434.598527:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254699520 00000100:00100000:0.0:1790945434.598538:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254699520 00000100:00100000:0.0:1790945434.598593:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 120 00000100:00100000:0.0:1790945434.598603:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+8:5620:x1877942254699520:12345-192.168.202.48@tcp:502: 00000100:00100000:0.0:1790945434.599126:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+8:5620:x1877942254699520:12345-192.168.202.48@tcp:502: Request processed in 522us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945434.599135:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 120 00000100:00100000:2.0:1790945434.612312:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945434.612362:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254699648 00000100:00100000:0.0:1790945434.612373:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254699648 00000100:00100000:0.0:1790945434.612420:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 121 00000100:00100000:0.0:1790945434.612429:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+8:5601:x1877942254699648:12345-192.168.202.48@tcp:101: 00010000:00010000:0.0:1790945434.612446:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945434.612463:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb840030a00/0xc5cf2c2a6a54f19a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8034 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945434.612506:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb840030a00/0xc5cf2c2a6a54f19a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8034 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945434.612516:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb840030a00/0xc5cf2c2a6a54f19a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8034 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945434.612525:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030a00, rc 0) 00000100:00100000:0.0:1790945434.612590:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+9:5601:x1877942254699648:12345-192.168.202.48@tcp:101: Request processed in 162us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945434.612598:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 121 00000100:00100000:1.0:1790945434.624110:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945434.624417:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254699776 00000100:00100000:3.0:1790945434.624429:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254699776 00000100:00100000:3.0:1790945434.624538:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 122 00000100:00100000:3.0:1790945434.624548:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+9:5601:x1877942254699776:12345-192.168.202.48@tcp:256: 20000000:01000000:3.0:1790945434.624576:0:5815:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790945434.624601:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790945434.624606:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790945434.624609:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790945434.624612:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1790945434.628031:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+9:5601:x1877942254699776:12345-192.168.202.48@tcp:256: Request processed in 3472us (3920us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945434.628047:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 122 00000100:00100000:3.0:1790945434.639226:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945434.640776:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254699904 00000100:00100000:0.0:1790945434.640790:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254699904 00000100:00100000:0.0:1790945434.641130:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 123 00000100:00100000:0.0:1790945434.641142:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+9:5601:x1877942254699904:12345-192.168.202.48@tcp:101: 00010000:00010000:0.0:1790945434.641160:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945434.641179:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb840030000/0xc5cf2c2a6a54f1a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c803b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945434.641729:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb840030000/0xc5cf2c2a6a54f1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c803b expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945434.641742:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb840030000/0xc5cf2c2a6a54f1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c803b expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945434.641751:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030000, rc 0) 00000100:00100000:0.0:1790945434.641818:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+10:5601:x1877942254699904:12345-192.168.202.48@tcp:101: Request processed in 678us (2602us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945434.641837:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 123 00000100:00100000:2.0:1790945434.645728:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945434.645870:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254700032 00000100:00100000:3.0:1790945434.645881:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254700032 00000100:00100000:3.0:1790945434.645968:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 124 00000100:00100000:3.0:1790945434.645978:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:5601:x1877942254700032:12345-192.168.202.48@tcp:501: 00000100:00100000:3.0:1790945434.646211:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:5601:x1877942254700032:12345-192.168.202.48@tcp:501: Request processed in 233us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945434.646219:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 124 00000100:00100000:3.0:1790945434.659743:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945434.659843:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254700160 00000100:00100000:0.0:1790945434.659853:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254700160 00000100:00100000:0.0:1790945434.659907:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 125 00000100:00100000:0.0:1790945434.659917:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:5601:x1877942254700160:12345-192.168.202.48@tcp:503: 00000100:00100000:0.0:1790945434.660606:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:5601:x1877942254700160:12345-192.168.202.48@tcp:503: Request processed in 688us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945434.660614:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 125 00000100:00100000:2.0:1790945434.681390:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945434.681994:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254700288 00000100:00100000:0.0:1790945434.682014:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254700288 00000100:00100000:0.0:1790945434.682072:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 126 00000100:00100000:0.0:1790945434.682083:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+10:5622:x1877942254700288:12345-192.168.202.48@tcp:502: 00000100:00100000:0.0:1790945434.682467:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+10:5622:x1877942254700288:12345-192.168.202.48@tcp:502: Request processed in 384us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945434.682475:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 126 00000100:00100000:3.0:1790945434.685308:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945434.685408:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254700416 00000100:00100000:2.0:1790945434.685419:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254700416 00000100:00100000:2.0:1790945434.685505:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 127 00000100:00100000:2.0:1790945434.685515:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+10:5622:x1877942254700416:12345-192.168.202.48@tcp:502: 00000100:00100000:2.0:1790945434.685753:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+10:5622:x1877942254700416:12345-192.168.202.48@tcp:502: Request processed in 238us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945434.685761:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 127 00000100:00100000:1.0:1790945434.691510:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945434.691623:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254700544 00000100:00100000:2.0:1790945434.691634:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254700544 00000100:00100000:2.0:1790945434.691787:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:2.0:1790945434.691795:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2369:x1877942254700544:12345-192.168.202.48@tcp:38: 00010000:00080000:2.0:1790945434.691833:0:7211:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:2.0:1790945434.691874:0:7211:0:(genops.c:1384:class_connect()) connect: client c6be5708-366a-4e39-b76f-5dba2d1f1a3b, cookie 0xc5cf2c2a6a54f1a8 00000004:00100000:2.0:1790945434.691902:0:7211:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1790945434.691908:0:7211:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1790945434.710997:0:7211:0:(import.c:65:import_set_state_nolock()) ffff9bb865e74000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790945434.712160:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2369:x1877942254700544:12345-192.168.202.48@tcp:38: Request processed in 20360us (20654us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945434.712173:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4 00010000:00010000:3.0:1790945435.355820:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945435.723613:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945435.723652:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945435.724020:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254700672 00000100:00100000:3.0:1790945435.724038:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254700672 00000100:00100000:3.0:1790945435.724146:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254700800 00000100:00100000:3.0:1790945435.724150:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254700800 00000100:00100000:3.0:1790945435.724200:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:1.0:1790945435.724220:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:3.0:1790945435.724221:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:0:x1877942254700672:12345-192.168.202.48@tcp:41: 00000100:00100000:1.0:1790945435.724244:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:5601:x1877942254700800:12345-192.168.202.48@tcp:41: 00000100:00080000:0.0:1790945435.724475:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1790945435.724617:0:5825:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790945435.724756:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:0:x1877942254700672:12345-192.168.202.48@tcp:41: Request processed in 544us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945435.724766:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5 00000004:00000024:1.0:1790945435.730011:0:5824:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790945435.730398:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:5601:x1877942254700800:12345-192.168.202.48@tcp:41: Request processed in 6160us (6737us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945435.730408:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:0.0:1790945435.733856:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945435.734084:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254700928 00000100:00100000:3.0:1790945435.734099:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254700928 00000100:00100000:3.0:1790945435.734184:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:3.0:1790945435.734196:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:5601:x1877942254700928:12345-192.168.202.48@tcp:40: 00000100:00100000:3.0:1790945435.734329:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:5601:x1877942254700928:12345-192.168.202.48@tcp:40: Request processed in 135us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945435.734338:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:0.0:1790945435.737776:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945435.737838:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945435.737956:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254701056 00000100:00100000:2.0:1790945435.737971:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254701056 00000100:00100000:2.0:1790945435.738044:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:2.0:1790945435.738054:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2369:x1877942254701056:12345-192.168.202.48@tcp:8: 00010000:00080000:2.0:1790945435.738098:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:2.0:1790945435.738143:0:6673:0:(genops.c:1384:class_connect()) connect: client c6be5708-366a-4e39-b76f-5dba2d1f1a3b, cookie 0xc5cf2c2a6a54f1af 00002000:00100000:2.0:1790945435.738161:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c6be5708-366a-4e39-b76f-5dba2d1f1a3b/ffff9bb86ca1d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790945435.738449:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1790945435.739022:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254701312 00000100:00100000:3.0:1790945435.739030:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254701312 00000100:00100000:3.0:1790945435.739088:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 128 00000100:00100000:3.0:1790945435.739097:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:2372:x1877942254701312:12345-192.168.202.48@tcp:400: 00000100:00100000:3.0:1790945435.739243:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:2372:x1877942254701312:12345-192.168.202.48@tcp:400: Request processed in 146us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945435.739251:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 128 00002000:00080000:2.0:1790945435.740437:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790945435.740498:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9bb86ca1b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945435.740579:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2369:x1877942254701056:12345-192.168.202.48@tcp:8: Request processed in 2521us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945435.740603:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:0.0:1790945435.743462:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945435.743990:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254701184 00000100:00100000:2.0:1790945435.744013:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254701184 00000100:00100000:2.0:1790945435.744081:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:2.0:1790945435.744092:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2369:x1877942254701184:12345-192.168.202.48@tcp:8: 00010000:00080000:2.0:1790945435.744136:0:6670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:2.0:1790945435.744394:0:6670:0:(genops.c:1384:class_connect()) connect: client c6be5708-366a-4e39-b76f-5dba2d1f1a3b, cookie 0xc5cf2c2a6a54f1b6 00002000:00100000:2.0:1790945435.744412:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c6be5708-366a-4e39-b76f-5dba2d1f1a3b/ffff9bb8654d3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790945435.744447:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790945435.746136:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790945435.746216:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9bb880e94800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945435.746347:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2369:x1877942254701184:12345-192.168.202.48@tcp:8: Request processed in 2251us (2897us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945435.746360:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:1.0:1790945435.751949:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945435.752079:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254701440 00000100:00100000:0.0:1790945435.752096:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254701440 00000100:00100000:0.0:1790945435.752165:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:0.0:1790945435.752435:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:5601:x1877942254701440:12345-192.168.202.48@tcp:33: 00000004:00080000:3.0:1790945435.779490:0:5826:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26943us 00000004:00200000:3.0:1790945435.796596:0:5826:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790945435.797421:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:5601:x1877942254701440:12345-192.168.202.48@tcp:33: Request processed in 44984us (45478us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945435.797446:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:3.0:1790945436.043729:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945436.043881:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254701568 00000100:00100000:2.0:1790945436.043896:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254701568 00000100:00100000:2.0:1790945436.045547:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:2.0:1790945436.045576:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:5640:x1877942254701568:12345-192.168.202.48@tcp:101: 00010000:00010000:2.0:1790945436.046027:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945436.046262:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afe00/0xc5cf2c2a6a54f1bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8065 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945436.046381:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af800/0xc5cf2c2a6a54f1c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945436.046399:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af800/0xc5cf2c2a6a54f1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945436.046417:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af800/0xc5cf2c2a6a54f1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945436.046454:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790945436.046458:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945436.046500:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af800/0xc5cf2c2a6a54f1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945436.046525:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afe00/0xc5cf2c2a6a54f1bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8065 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945436.046544:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af800/0xc5cf2c2a6a54f1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8065 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945436.046551:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb845042f00) 00010000:00010000:2.0:1790945436.046554:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945436.046557:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434af800, rc 0) 00000100:00100000:2.0:1790945436.046639:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:5640:x1877942254701568:12345-192.168.202.48@tcp:101: Request processed in 1077us (2925us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945436.046646:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8 00010000:00010000:0.0:1790945436.380618:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945437.408713:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945437.468111:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273597824:0@lo:400: 00000100:00100000:0.0:1790945437.468371:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273597568:0@lo:400: 00000100:00100000:0.0:1790945437.468415:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945437.468482:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273598080:0@lo:400: 00000100:00100000:2.0:1790945437.469223:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273597952:0@lo:400: 00000100:00100000:2.0:1790945437.469267:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945437.469335:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273597568 00000100:00100000:2.0:1790945437.469344:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273597568 00000100:00100000:2.0:1790945437.469390:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790945437.469399:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273597568:12345-0@lo:400: 00000100:00100000:2.0:1790945437.469465:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273597568:12345-0@lo:400: Request processed in 66us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945437.469472:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790945437.469917:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273597696:0@lo:400: 00000100:00100000:0.0:1790945437.470025:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273597952 00000100:00100000:0.0:1790945437.470030:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273597952 00000100:00100000:0.0:1790945437.470085:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790945437.470093:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273597952:12345-0@lo:400: 00000100:00100000:0.0:1790945437.470137:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273597952:12345-0@lo:400: Request processed in 45us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945437.470156:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790945437.470192:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f88a80 x1877942273597952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945437.470217:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273597952:0@lo:400: 00000100:00100000:3.0:1790945437.470525:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945437.470624:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945437.470672:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273598208:0@lo:400: 00000100:00100000:1.0:1790945437.470704:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945437.470744:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945437.470772:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273597568:0@lo:400: 00000100:00100000:1.0:1790945437.470795:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273597824 00000100:00100000:1.0:1790945437.470799:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273597824 00000100:00100000:1.0:1790945437.470828:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273597696 00000100:00100000:1.0:1790945437.470831:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273597696 00000100:00100000:1.0:1790945437.470844:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273598080 00000100:00100000:1.0:1790945437.470847:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273598080 00000100:00100000:1.0:1790945437.470861:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790945437.470868:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273597824:12345-0@lo:400: 00000100:00100000:1.0:1790945437.470902:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273597824:12345-0@lo:400: Request processed in 35us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945437.470908:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790945437.470920:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790945437.470926:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273597696:12345-0@lo:400: 00000100:00100000:1.0:1790945437.470954:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273597696:12345-0@lo:400: Request processed in 29us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945437.470960:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790945437.470972:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790945437.471026:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273598080:12345-0@lo:400: 00000100:00100000:1.0:1790945437.471061:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273598080:12345-0@lo:400: Request processed in 37us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945437.471067:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790945437.471094:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273597696:0@lo:400: 00000100:00100000:1.0:1790945437.471121:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273598080:0@lo:400: 00000100:00100000:1.0:1790945437.471164:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273597824:0@lo:400: 00000100:00080000:2.0:1790945437.471904:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945437.471911:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945437.472093:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273598208 00000100:00100000:0.0:1790945437.472100:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273598208 00000100:00100000:0.0:1790945437.472160:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790945437.472169:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273598208:12345-0@lo:400: 00000100:00100000:0.0:1790945437.472450:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273598208:12345-0@lo:400: Request processed in 282us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945437.472458:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790945437.472595:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f88e00 x1877942273598208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945437.472605:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1790945437.472637:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273598208:0@lo:400: 00000100:00080000:2.0:1790945437.472710:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790945437.980345:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945437.980371:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273598336:0@lo:13: 00000100:00100000:0.0:1790945437.980447:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945437.980948:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945437.980958:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872feca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273598464:0@lo:13: 00000100:00100000:1.0:1790945437.981030:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945437.981123:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273598336 00000100:00100000:0.0:1790945437.981143:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273598336 00000100:00100000:0.0:1790945437.981180:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273598464 00000100:00100000:0.0:1790945437.981183:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273598464 00000100:00100000:0.0:1790945437.981198:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790945437.981205:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273598336:12345-0@lo:13: 00002000:00000024:0.0:1790945437.981239:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945437.981298:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273598336:12345-0@lo:13: Request processed in 92us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945437.981305:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790945437.981321:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790945437.981328:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273598464:12345-0@lo:13: 00002000:00000024:0.0:1790945437.981348:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945437.981383:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273598464:12345-0@lo:13: Request processed in 56us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945437.981389:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1790945437.981422:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb872feca80 x1877942273598464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945437.981441:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872feca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273598464:0@lo:13: 00010000:00080000:1.0:1790945437.981529:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87acfce00 x1877942273598336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945437.981542:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273598336:0@lo:13: 00000100:00100000:3.0:1790945438.383820:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945438.384210:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254701696 00000100:00100000:1.0:1790945438.384229:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254701696 00000100:00100000:1.0:1790945438.384354:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:1.0:1790945438.384371:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:5692:x1877942254701696:12345-192.168.202.48@tcp:41: 00000100:00080000:2.0:1790945438.384383:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1790945438.384451:0:5824:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790945438.384568:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:5692:x1877942254701696:12345-192.168.202.48@tcp:41: Request processed in 203us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945438.384577:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:0.0:1790945438.397352:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945438.397487:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254701824 00000100:00100000:2.0:1790945438.397501:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254701824 00000100:00100000:2.0:1790945438.397606:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:2.0:1790945438.397619:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:5692:x1877942254701824:12345-192.168.202.48@tcp:13: 00002000:00000024:2.0:1790945438.397697:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945438.403551:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:5692:x1877942254701824:12345-192.168.202.48@tcp:13: Request processed in 5918us (6197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945438.403585:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00080000:0.0:1790945438.403839:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945438.412090:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945438.418099:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254701952 00000100:00100000:0.0:1790945438.418124:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254701952 00000100:00100000:0.0:1790945438.418246:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:0.0:1790945438.418260:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:5692:x1877942254701952:12345-192.168.202.48@tcp:13: 00002000:00000024:0.0:1790945438.418296:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945438.418391:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:5692:x1877942254701952:12345-192.168.202.48@tcp:13: Request processed in 133us (6387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945438.418421:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00080000:2.0:1790945438.418546:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790945438.428832:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945439.451876:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790945439.675725:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000001:00100000:0.0:1790945440.082090:0:5846:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000001:00100000:3.0:1790945440.092165:0:7627:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00010000:00010000:0.0:1790945440.478484:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945440.925597:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945440.925858:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254702080 00000100:00100000:3.0:1790945440.925872:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254702080 00000100:00100000:1.0:1790945440.925910:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945440.925956:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 130 00000100:00100000:1.0:1790945440.925956:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945440.925974:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+10:2370:x1877942254702080:12345-192.168.202.48@tcp:400: 00000100:00100000:1.0:1790945440.925989:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254702336 00000100:00100000:1.0:1790945440.926003:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254702336 00000100:00100000:1.0:1790945440.926054:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:1.0:1790945440.926063:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872feca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254702336:12345-192.168.202.48@tcp:400: 00000100:00100000:1.0:1790945440.926130:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872feca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254702336:12345-192.168.202.48@tcp:400: Request processed in 68us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945440.926137:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:2.0:1790945440.926239:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254702208 00000100:00100000:2.0:1790945440.926243:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254702208 00000100:00100000:2.0:1790945440.926282:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 25 00000100:00100000:2.0:1790945440.926289:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254702208:12345-192.168.202.48@tcp:400: 00000100:00100000:3.0:1790945440.926772:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+10:2370:x1877942254702080:12345-192.168.202.48@tcp:400: Request processed in 802us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945440.926782:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 130 00000100:00100000:3.0:1790945440.927876:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945440.930320:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254702464 00000100:00100000:3.0:1790945440.930356:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254702464 00000100:00100000:3.0:1790945440.930447:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:3.0:1790945440.930461:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2371:x1877942254702464:12345-192.168.202.48@tcp:400: 00000100:00100000:3.0:1790945440.930561:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2371:x1877942254702464:12345-192.168.202.48@tcp:400: Request processed in 103us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945440.930569:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00080000:3.0:1790945440.934035:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945440.934048:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945440.934052:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945440.937969:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254702208:12345-192.168.202.48@tcp:400: Request processed in 11648us (12028us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945440.938002:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 25 00000001:02000400:2.0:1790945441.345645:0:8286:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790945441.505839:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945442.525963:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945442.588941:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273598976:0@lo:400: 00000100:00100000:3.0:1790945442.589044:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945442.589121:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790945442.589128:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273598592:0@lo:400: 00000100:00100000:3.0:1790945442.589160:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945442.589184:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273599104:0@lo:400: 00000100:00100000:3.0:1790945442.589210:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945442.589238:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273598720:0@lo:400: 00000100:00100000:3.0:1790945442.589264:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945442.589281:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273599232:0@lo:400: 00000100:00100000:3.0:1790945442.589303:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945442.589323:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945442.589328:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273598848:0@lo:400: 00000100:00100000:3.0:1790945442.589353:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945442.589391:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273598976 00000100:00100000:3.0:1790945442.589402:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273598976 00000100:00100000:3.0:1790945442.589469:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273599232 00000100:00100000:3.0:1790945442.589472:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273599232 00000100:00100000:3.0:1790945442.589518:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790945442.589530:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273598976:12345-0@lo:400: 00000100:00100000:3.0:1790945442.589597:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273598976:12345-0@lo:400: Request processed in 69us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945442.589605:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790945442.589628:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790945442.589634:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273599232:12345-0@lo:400: 00000100:00100000:3.0:1790945442.589705:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273599232:12345-0@lo:400: Request processed in 71us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945442.589712:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790945442.589733:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273599104 00000100:00100000:3.0:1790945442.589737:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273599104 00000100:00100000:3.0:1790945442.589765:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273598720 00000100:00100000:3.0:1790945442.589768:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273598720 00000100:00100000:3.0:1790945442.589780:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273598848 00000100:00100000:3.0:1790945442.589782:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273598848 00000100:00100000:3.0:1790945442.589798:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790945442.589804:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273599104:12345-0@lo:400: 00000100:00100000:3.0:1790945442.589837:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273599104:12345-0@lo:400: Request processed in 33us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945442.589843:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790945442.589856:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945442.589862:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273598720:12345-0@lo:400: 00000100:00100000:3.0:1790945442.589894:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273598720:12345-0@lo:400: Request processed in 32us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945442.589900:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945442.589911:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790945442.589917:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273598848:12345-0@lo:400: 00000100:00100000:3.0:1790945442.589966:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273598848:12345-0@lo:400: Request processed in 48us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945442.589972:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1790945442.590001:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945442.590007:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945442.590010:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945442.590056:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273598848:0@lo:400: 00000100:00100000:3.0:1790945442.590070:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273598720:0@lo:400: 00010000:00080000:3.0:1790945442.590082:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f8bb80 x1877942273599232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945442.590093:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273599232:0@lo:400: 00000100:00100000:3.0:1790945442.590133:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273599104:0@lo:400: 00010000:00080000:3.0:1790945442.590143:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f8ad80 x1877942273598976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945442.590151:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273598976:0@lo:400: 00000100:00100000:1.0:1790945442.590677:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273598592 00000100:00100000:1.0:1790945442.590695:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273598592 00000100:00100000:1.0:1790945442.590736:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790945442.590845:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273598592:12345-0@lo:400: 00000100:00100000:1.0:1790945442.590913:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273598592:12345-0@lo:400: Request processed in 169us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945442.590921:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790945442.590973:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273598592:0@lo:400: 00000100:00100000:2.0:1790945443.099900:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945443.099947:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273599360:0@lo:13: 00000100:00100000:2.0:1790945443.100057:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945443.100133:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273599360 00000100:00100000:2.0:1790945443.100143:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273599360 00000100:00100000:2.0:1790945443.100216:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790945443.100227:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273599360:12345-0@lo:13: 00002000:00000024:2.0:1790945443.100277:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945443.100333:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273599360:12345-0@lo:13: Request processed in 108us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945443.100340:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1790945443.100388:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87acfc700 x1877942273599360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945443.100408:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273599360:0@lo:13: 00000100:00100000:0.0:1790945443.100701:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273599488:0@lo:13: 00000100:00100000:0.0:1790945443.100771:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945443.100820:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273599488 00000100:00100000:1.0:1790945443.100825:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273599488 00000100:00100000:1.0:1790945443.100863:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790945443.100871:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273599488:12345-0@lo:13: 00002000:00000024:1.0:1790945443.100896:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945443.100959:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273599488:12345-0@lo:13: Request processed in 88us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945443.100965:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1790945443.101006:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb872fec380 x1877942273599488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945443.101020:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273599488:0@lo:13: 00010000:00010000:0.0:1790945443.549952:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945444.575834:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790945444.868283:0:8434:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce6c164b0 20000000:00000080:3.0:1790945444.868299:0:8434:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb87b554000 uarg=0000000000000000 20000000:01000000:3.0:1790945444.868332:0:8434:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1790945444.868335:0:8434:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1790945444.868651:0:8434:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790945444.868769:0:8434:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790945444.868776:0:8434:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1790945444.868792:0:8434:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790945444.868794:0:8434:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790945444.869080:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790945444.869084:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790945444.875943:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1790945444.884006:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1790945444.884083:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1790945444.884122:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1790945444.884136:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790945444.884139:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790945444.888151:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1790945444.890066:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1790945444.890121:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1790945444.890156:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1790945444.890172:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790945444.890175:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790945444.893295:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1790945444.893804:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1790945444.893871:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1790945444.893922:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1790945444.893937:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790945444.893947:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790945444.895180:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1790945444.897537:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1790945444.897596:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1790945444.897692:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:1.0:1790945444.897713:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790945444.897735:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.897811:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f0c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f0c1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.897820:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54f0f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f0eb expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.897826:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb840030e00/0xc5cf2c2a6a54f11c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f115 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.897832:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f12a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f123 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.897839:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f131 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.897847:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f14d expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.897854:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb840031200/0xc5cf2c2a6a54f17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f177 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.897863:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb840030600/0xc5cf2c2a6a54f18c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8003 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.897886:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8821c4000/0xc5cf2c2a6a54f193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c800a expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.897894:0:8434:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.897944:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8821c4000/0xc5cf2c2a6a54f193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c800a expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.897960:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb8821c4000/0xc5cf2c2a6a54f193 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c800a expref: 9 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.897976:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273599616:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945444.898081:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb840030600/0xc5cf2c2a6a54f18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8003 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.898090:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb840030600/0xc5cf2c2a6a54f18c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8003 expref: 9 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.898099:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273599744:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945444.898142:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb840031200/0xc5cf2c2a6a54f17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f177 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.898150:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb840031200/0xc5cf2c2a6a54f17e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f177 expref: 18 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.898160:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273599872:0@lo:104: 00000100:00100000:1.0:1790945444.898199:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790945444.898338:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f14d expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.898347:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f14d expref: 18 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.898354:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273600000:0@lo:104: 00000100:00100000:1.0:1790945444.898377:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790945444.904755:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f131 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.904774:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f138 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f131 expref: 18 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.904789:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273600128:0@lo:104: 00010000:00010000:1.0:1790945444.904840:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f123 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.904848:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f12a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f123 expref: 18 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.904856:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273600256:0@lo:104: 00010000:00010000:1.0:1790945444.904882:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb840030e00/0xc5cf2c2a6a54f11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f115 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.904890:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb840030e00/0xc5cf2c2a6a54f11c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f115 expref: 18 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.904898:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273600384:0@lo:104: 00010000:00010000:1.0:1790945444.904937:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54f0f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0eb expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.904959:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54f0f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0eb expref: 18 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.904968:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273600512:0@lo:104: 00010000:00010000:1.0:1790945444.904993:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0c1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.905001:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f0c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0c1 expref: 18 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.905009:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273600640:0@lo:104: 00000100:00100000:1.0:1790945444.905027:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865443480 going to sleep for 11 seconds 00000100:00100000:1.0:1790945444.905051:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273599616:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945444.905061:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273599744:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945444.906594:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945444.906631:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945444.906808:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254702592 00000100:00100000:3.0:1790945444.906817:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254702592 00010000:00010000:3.0:1790945444.906855:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8821c4000/0xc5cf2c2a6a54f193 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c800a expref: 10 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945444.906892:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254702720 00000100:00100000:3.0:1790945444.906896:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254702720 00010000:00010000:3.0:1790945444.906917:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb840030600/0xc5cf2c2a6a54f18c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8003 expref: 11 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945444.906940:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:3.0:1790945444.906949:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee3b157-ad31-4030-99ec-031c727e7689+11:2372:x1877942254702592:12345-192.168.202.48@tcp:103: 00010000:00010000:3.0:1790945444.906963:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945444.906969:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8821c4000/0xc5cf2c2a6a54f193 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c800a expref: 11 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945444.906980:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8821c4000/0xc5cf2c2a6a54f193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c800a expref: 11 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945444.906997:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c4000/0xc5cf2c2a6a54f193 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c800a expref: 11 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945444.907024:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945444.907077:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee3b157-ad31-4030-99ec-031c727e7689+10:2372:x1877942254702592:12345-192.168.202.48@tcp:103: Request processed in 129us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945444.907085:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:3.0:1790945444.907454:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:3.0:1790945444.907464:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee3b157-ad31-4030-99ec-031c727e7689+9:2372:x1877942254702720:12345-192.168.202.48@tcp:103: 00010000:00010000:3.0:1790945444.907475:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945444.907479:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb840030600/0xc5cf2c2a6a54f18c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8003 expref: 9 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945444.907489:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb840030600/0xc5cf2c2a6a54f18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8003 expref: 9 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945444.907500:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb840030600/0xc5cf2c2a6a54f18c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8003 expref: 9 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945444.907510:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945444.907534:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee3b157-ad31-4030-99ec-031c727e7689+8:2372:x1877942254702720:12345-192.168.202.48@tcp:103: Request processed in 72us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945444.907540:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:2.0:1790945444.910611:0:5807:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790945444.910674:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945444.910714:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945444.910727:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945444.910731:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273599872 00000100:00100000:2.0:1790945444.910739:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945444.910742:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273599872 00000100:00100000:2.0:1790945444.910769:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945444.910780:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273600000 00000100:00100000:2.0:1790945444.910785:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273600000 00000100:00100000:1.0:1790945444.910785:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273600128 00000100:00100000:1.0:1790945444.910790:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273600128 00000100:00100000:1.0:1790945444.910816:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273600256 00000100:00100000:2.0:1790945444.910818:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273600384 00000100:00100000:1.0:1790945444.910819:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273600256 00000100:00100000:2.0:1790945444.910823:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273600384 00000100:00100000:1.0:1790945444.910841:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273600512 00000100:00100000:2.0:1790945444.910845:0:5807:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273600640 00000100:00100000:1.0:1790945444.910845:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273600512 00000100:00100000:2.0:1790945444.910862:0:5807:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273600640 00000100:00100000:1.0:1790945444.910867:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790945444.910878:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:8434:x1877942273599872:12345-0@lo:104: 00000100:00100000:2.0:1790945444.910889:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1790945444.910895:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f17e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945444.910931:0:5807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:8434:x1877942273600000:12345-0@lo:104: 00010000:00010000:2.0:1790945444.910941:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f154 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.911264:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790945444.911271:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+9:8434:x1877942273599872:12345-0@lo:104: Request processed in 396us (13071us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945444.911279:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790945444.911296:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790945444.911302:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+8:8434:x1877942273600128:12345-0@lo:104: 00010000:00010000:1.0:1790945444.911310:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f138 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945444.916552:0:7614:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:0.0:1790945444.916587:0:7614:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00010000:00010000:2.0:1790945444.916784:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790945444.916797:0:5807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+8:8434:x1877942273600000:12345-0@lo:104: Request processed in 5864us (18414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945444.916812:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1790945444.916850:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790945444.916860:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+7:8434:x1877942273600128:12345-0@lo:104: Request processed in 5557us (6201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945444.916870:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790945444.916877:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790945444.916891:0:5807:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+6:8434:x1877942273600256:12345-0@lo:104: 00000100:00100000:1.0:1790945444.916897:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790945444.916917:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+6:8434:x1877942273600384:12345-0@lo:104: 00010000:00010000:2.0:1790945444.916920:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f12a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.916928:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f11c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.917037:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1790945444.917043:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+6:8434:x1877942273600384:12345-0@lo:104: Request processed in 139us (6316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945444.917050:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790945444.917064:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790945444.917069:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+5:8434:x1877942273600512:12345-0@lo:104: 00010000:00010000:1.0:1790945444.917077:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f0f2 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.917146:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1790945444.917152:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+5:8434:x1877942273600512:12345-0@lo:104: Request processed in 83us (6413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945444.917159:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790945444.917174:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790945444.917181:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:8434:x1877942273600640:12345-0@lo:104: 00010000:00010000:1.0:1790945444.917188:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f0c8 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.917217:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1790945444.917222:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:8434:x1877942273600640:12345-0@lo:104: Request processed in 42us (6455us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945444.917228:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790945444.917256:0:7614:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00000100:00100000:1.0:1790945444.917299:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273599872:0@lo:104: 00000100:00100000:1.0:1790945444.917310:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273600000:0@lo:104: 00000100:00100000:1.0:1790945444.917324:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273600128:0@lo:104: 00000100:00100000:1.0:1790945444.917331:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273600384:0@lo:104: 00000100:00100000:1.0:1790945444.917338:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273600512:0@lo:104: 00000100:00100000:1.0:1790945444.917345:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273600640:0@lo:104: 00010000:00010000:0.0:1790945444.917600:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1790945444.917608:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f17e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.917616:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5000 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1790945444.917621:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f17e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.917630:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f17e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945444.917637:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f17e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945444.917651:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945444.917718:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f17e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.917725:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945444.918243:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1790945444.918250:0:5807:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:8434:x1877942273600256:12345-0@lo:104: Request processed in 1364us (7535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945444.918258:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1790945444.918428:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f17e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918437:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5000/0xc5cf2c2a6a54f177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f17e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918452:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1790945444.918455:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f154 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918461:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8414a7000 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1790945444.918465:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f154 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918472:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f154 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945444.918479:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f154 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945444.918485:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945444.918501:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f154 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918507:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945444.918532:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f154 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918539:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8414a7000/0xc5cf2c2a6a54f14d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f154 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918552:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790945444.918556:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f138 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.918561:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1877942273600256:0@lo:104: 00010000:00010000:0.0:1790945444.918565:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1790945444.918569:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f138 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918576:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f138 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945444.918583:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f138 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945444.918589:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945444.918608:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f138 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918614:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945444.918617:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918620:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f138 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918636:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a54f131 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f138 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918646:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790945444.918676:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f11c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918683:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167a400 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1790945444.918686:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f11c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918693:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f11c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.918695:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273600896:0@lo:103: 10000000:00010000:0.0:1790945444.918699:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f11c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945444.918704:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945444.918720:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f11c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918726:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945444.918732:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f11c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918738:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb84167a400/0xc5cf2c2a6a54f115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f11c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.918758:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945444.918797:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945444.918803:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273601024:0@lo:103: 00000100:00100000:1.0:1790945444.918823:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945444.918845:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273601152:0@lo:103: 00000100:00100000:1.0:1790945444.918864:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945444.918878:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945444.918882:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273600768:0@lo:103: 00000100:00100000:1.0:1790945444.918899:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945444.918934:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273600896 00000100:00100000:1.0:1790945444.918940:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273600896 00010000:00010000:1.0:1790945444.918968:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f14d expref: 19 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.918981:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1790945444.918986:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273601024 00010000:00010000:0.0:1790945444.918986:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f0f2 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.918990:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273601024 00010000:00010000:0.0:1790945444.918998:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030400 already unused, calling callback (ffffffffc1c63c20) 00010000:00010000:1.0:1790945444.919005:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f138 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f131 expref: 20 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945444.919005:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f0f2 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.919025:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273601152 00000100:00100000:1.0:1790945444.919029:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273601152 00010000:00010000:0.0:1790945444.919037:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f0f2 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919042:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb840030e00/0xc5cf2c2a6a54f11c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f115 expref: 21 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945444.919048:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f0f2 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.919056:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273600768 10000000:01000000:0.0:1790945444.919056:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1790945444.919061:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273600768 00010000:00010000:1.0:1790945444.919075:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb840031200/0xc5cf2c2a6a54f17e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f177 expref: 22 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.919077:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f0f2 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.919090:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945444.919103:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f0f2 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.919110:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1790945444.919112:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb840030400/0xc5cf2c2a6a54f0eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f0f2 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.919126:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+22:3292:x1877942273600896:12345-0@lo:103: 00010000:00010000:1.0:1790945444.919147:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945444.919152:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f14d expref: 22 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919161:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f14d expref: 22 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919173:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a6800/0xc5cf2c2a6a54f154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f14d expref: 22 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919185:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945444.919199:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790945444.919203:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f0c8 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.919209:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167ae00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1790945444.919212:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f0c8 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.919220:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+21:3292:x1877942273600896:12345-0@lo:103: Request processed in 96us (462us total) trans 0 rc 0/0 00010000:00010000:0.0:1790945444.919221:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f0c8 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.919232:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 10000000:00010000:0.0:1790945444.919235:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f0c8 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.919248:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 10000000:01000000:0.0:1790945444.919251:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1790945444.919257:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+20:3292:x1877942273601024:12345-0@lo:103: 00010000:00010000:1.0:1790945444.919266:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945444.919270:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f0c8 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919271:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f138 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f131 expref: 20 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.919288:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945444.919291:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f131 expref: 20 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.919297:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f0c8 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919303:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f138 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f131 expref: 20 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919311:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945444.919331:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273601024:12345-0@lo:103: Request processed in 76us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945444.919345:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790945444.919357:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790945444.919363:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:3294:x1877942273601152:12345-0@lo:103: 00010000:00010000:1.0:1790945444.919371:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945444.919375:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb840030e00/0xc5cf2c2a6a54f11c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f115 expref: 18 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919383:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb840030e00/0xc5cf2c2a6a54f11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f115 expref: 18 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919392:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb840030e00/0xc5cf2c2a6a54f11c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f115 expref: 18 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919401:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945444.919423:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:3294:x1877942273601152:12345-0@lo:103: Request processed in 60us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945444.919429:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790945444.919439:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790945444.919444:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:3294:x1877942273600768:12345-0@lo:103: 00010000:00010000:1.0:1790945444.919451:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945444.919455:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb840031200/0xc5cf2c2a6a54f17e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f177 expref: 16 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919463:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb840031200/0xc5cf2c2a6a54f17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f177 expref: 16 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919472:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb840031200/0xc5cf2c2a6a54f17e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f177 expref: 16 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919494:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945444.919518:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:3294:x1877942273600768:12345-0@lo:103: Request processed in 73us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945444.919524:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790945444.919544:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273601408:0@lo:103: 00000100:00100000:1.0:1790945444.919567:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945444.919590:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273601024:0@lo:103: 00000100:00100000:1.0:1790945444.919598:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273600896:0@lo:103: 00010000:00010000:0.0:1790945444.919612:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a54f0c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f0c8 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.919624:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945444.919628:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f12a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.919629:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273601408 00000100:00100000:1.0:1790945444.919634:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273601408 00010000:00010000:0.0:1790945444.919636:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031c00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1790945444.919640:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f12a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.919647:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f12a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919651:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f0c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0c1 expref: 15 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945444.919683:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f12a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945444.919690:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1790945444.919694:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790945444.919702:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:3292:x1877942273601408:12345-0@lo:103: 00010000:00010000:0.0:1790945444.919708:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f12a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919710:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945444.919718:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f0c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0c1 expref: 15 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.919718:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945444.919728:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0c1 expref: 15 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919739:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a54f0c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0c1 expref: 15 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.919740:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f12a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.919751:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945444.919779:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:3292:x1877942273601408:12345-0@lo:103: Request processed in 79us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945444.919784:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1790945444.920117:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945444.922569:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb840031c00/0xc5cf2c2a6a54f123 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f12a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.922609:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945444.922612:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945444.922615:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945444.922653:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273601536:0@lo:103: 00000100:00100000:1.0:1790945444.922738:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273601280:0@lo:103: 00000100:00100000:1.0:1790945444.925758:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273600768:0@lo:103: 00000100:00100000:1.0:1790945444.925773:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273601152:0@lo:103: 00000100:00100000:0.0:1790945444.925799:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945444.925853:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945444.925903:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273601408:0@lo:103: 00000100:00100000:2.0:1790945444.926468:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273601536 00000100:00100000:2.0:1790945444.926476:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273601536 00010000:00010000:2.0:1790945444.926512:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f12a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f123 expref: 14 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945444.926545:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273601280 00000100:00100000:2.0:1790945444.926550:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273601280 00010000:00010000:2.0:1790945444.926563:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54f0f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0eb expref: 15 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945444.926570:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790945444.926583:0:5810:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790945444.926584:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:3293:x1877942273601536:12345-0@lo:103: 00000100:00100000:2.0:1790945444.926597:0:5810:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1790945444.926602:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945444.926610:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f12a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f123 expref: 15 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926624:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f123 expref: 15 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926642:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f12a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f123 expref: 15 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926674:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945444.926730:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:3293:x1877942273601536:12345-0@lo:103: Request processed in 149us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945444.926738:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790945444.926756:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790945444.926763:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:3295:x1877942273601280:12345-0@lo:103: 00010000:00010000:1.0:1790945444.926771:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945444.926775:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54f0f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0eb expref: 13 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926793:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54f0f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0eb expref: 13 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926805:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c4200/0xc5cf2c2a6a54f0f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0eb expref: 13 pid: 5818 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926818:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926826:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926841:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926848:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926855:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926862:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926869:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167bc00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945444.926873:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926882:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926931:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945444.926943:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945444.926974:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:3295:x1877942273601280:12345-0@lo:103: Request processed in 212us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945444.926980:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790945444.927009:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273601280:0@lo:103: 00010000:00010000:0.0:1790945444.927447:0:8434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.927456:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945444.927462:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f1cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945444.929715:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273601536:0@lo:103: 00010000:00010000:3.0:1790945445.595830:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945446.040290:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945446.040348:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945446.040439:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945446.040479:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945446.040533:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254702976 00000100:00100000:0.0:1790945446.040544:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254702976 00000100:00100000:0.0:1790945446.040611:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 29 00000100:00100000:0.0:1790945446.040622:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254702976:12345-192.168.202.48@tcp:400: 00000100:00100000:0.0:1790945446.040755:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254702976:12345-192.168.202.48@tcp:400: Request processed in 134us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945446.040763:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 29 00000100:00080000:0.0:1790945446.040787:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945446.041064:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254702848 00000100:00100000:2.0:1790945446.041069:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254702848 00000100:00100000:2.0:1790945446.041120:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 132 00000100:00100000:2.0:1790945446.041127:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+8:2372:x1877942254702848:12345-192.168.202.48@tcp:400: 00000100:00100000:2.0:1790945446.041166:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+8:2372:x1877942254702848:12345-192.168.202.48@tcp:400: Request processed in 39us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945446.041172:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 132 00000100:00100000:1.0:1790945446.049560:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254703104 00000100:00100000:1.0:1790945446.049575:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254703104 00000100:00100000:1.0:1790945446.049672:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254703232 00000100:00100000:1.0:1790945446.049676:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254703232 00000100:00080000:0.0:1790945446.049789:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945446.049794:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945446.049840:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:1.0:1790945446.049851:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2372:x1877942254703104:12345-192.168.202.48@tcp:400: 00000100:00100000:1.0:1790945446.049982:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2372:x1877942254703104:12345-192.168.202.48@tcp:400: Request processed in 133us (9643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945446.049990:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:1.0:1790945446.050015:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:1.0:1790945446.050022:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2372:x1877942254703232:12345-192.168.202.48@tcp:400: 00000100:00100000:1.0:1790945446.050046:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2372:x1877942254703232:12345-192.168.202.48@tcp:400: Request processed in 25us (9567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945446.050052:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12 10000000:01000000:1.0:1790945446.172044:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790945446.172053:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bb87fbcd800 from 39 10000000:01000000:1.0:1790945446.172070:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790945446.172120:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945446.172146:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945446.172159:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945446.172187:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273601664:0@lo:101: 00000100:00100000:1.0:1790945446.172267:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945446.172330:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fb780 going to sleep for 11 seconds 00000100:00100000:3.0:1790945446.172404:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273601664 00000100:00100000:3.0:1790945446.172418:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273601664 00000100:00100000:3.0:1790945446.172472:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790945446.172482:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+12:5820:x1877942273601664:12345-0@lo:101: 00010000:00010000:3.0:1790945446.172498:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945446.172512:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8414a7400/0xc5cf2c2a6a54f1d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f1d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.172535:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8414a7400/0xc5cf2c2a6a54f1d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f1d2 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.172546:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8414a7400/0xc5cf2c2a6a54f1d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f1d2 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.172555:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8414a7400, rc 0) 00000100:00100000:3.0:1790945446.172607:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:5820:x1877942273601664:12345-0@lo:101: Request processed in 126us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.172614:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790945446.173318:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273601664:0@lo:101: 00010000:00010000:1.0:1790945446.173349:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945446.173359:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945446.173425:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273601792:0@lo:501: 00000100:00100000:1.0:1790945446.173461:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945446.173496:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fb780 going to sleep for 11 seconds 00000100:00100000:0.0:1790945446.173548:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273601792 00000100:00100000:0.0:1790945446.173554:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273601792 00000100:00100000:0.0:1790945446.173593:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790945446.173602:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:5820:x1877942273601792:12345-0@lo:501: 00000100:00100000:0.0:1790945446.173907:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:5820:x1877942273601792:12345-0@lo:501: Request processed in 297us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945446.173915:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790945446.174332:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273601792:0@lo:501: 00000100:00100000:1.0:1790945446.174377:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273601920:0@lo:503: 00000100:00100000:1.0:1790945446.174419:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945446.174449:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fb780 going to sleep for 11 seconds 00000100:00100000:2.0:1790945446.174510:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273601920 00000100:00100000:2.0:1790945446.174515:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273601920 00000100:00100000:2.0:1790945446.174550:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790945446.174559:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:5820:x1877942273601920:12345-0@lo:503: 00000100:00100000:2.0:1790945446.174776:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:5820:x1877942273601920:12345-0@lo:503: Request processed in 218us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945446.174783:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790945446.174927:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273601920:0@lo:503: 00000100:00100000:2.0:1790945446.175473:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8454:1877942273602048:0@lo:502: 00000100:00100000:2.0:1790945446.175516:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945446.175550:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945446.175635:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273602048 00000100:00100000:3.0:1790945446.175641:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273602048 00000100:00100000:3.0:1790945446.175695:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790945446.175714:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:8454:x1877942273602048:12345-0@lo:502: 00000100:00100000:3.0:1790945446.175922:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:8454:x1877942273602048:12345-0@lo:502: Request processed in 219us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.175930:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790945446.176071:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8454:1877942273602048:0@lo:502: 00000100:00100000:1.0:1790945446.176130:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8454:1877942273602176:0@lo:502: 00000100:00100000:1.0:1790945446.176165:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945446.176193:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fb780 going to sleep for 11 seconds 00000100:00100000:2.0:1790945446.176368:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273602176 00000100:00100000:2.0:1790945446.176373:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273602176 00000100:00100000:2.0:1790945446.176394:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790945446.176401:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:8454:x1877942273602176:12345-0@lo:502: 00000100:00100000:2.0:1790945446.176561:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:8454:x1877942273602176:12345-0@lo:502: Request processed in 160us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945446.176568:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790945446.176893:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8454:1877942273602176:0@lo:502: 00000040:00080000:1.0:1790945446.176930:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790945446.179255:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790945446.179288:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790945446.179300:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.179313:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945446.179326:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1790945446.179329:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1790945446.179332:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790945446.179382:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.179390:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.179400:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945446.179421:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273602304:0@lo:101: 00000100:00100000:2.0:1790945446.179487:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945446.179543:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c2300 going to sleep for 11 seconds 00000100:00100000:3.0:1790945446.181439:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273602304 00000100:00100000:3.0:1790945446.181453:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273602304 00000100:00100000:3.0:1790945446.181521:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790945446.181532:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+13:5820:x1877942273602304:12345-0@lo:101: 00010000:00010000:3.0:1790945446.181553:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945446.181584:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8414a7000/0xc5cf2c2a6a54f1e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f1e0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.181613:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8414a7000/0xc5cf2c2a6a54f1e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f1e0 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.181625:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8414a7000/0xc5cf2c2a6a54f1e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f1e0 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.181633:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8414a7000, rc 0) 00000100:00100000:3.0:1790945446.181810:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273602304:12345-0@lo:101: Request processed in 280us (2322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.181818:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790945446.182223:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273602304:0@lo:101: 00010000:00010000:2.0:1790945446.182242:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.182250:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945446.182325:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273602432:0@lo:501: 00000100:00100000:2.0:1790945446.182370:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945446.182403:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c2300 going to sleep for 11 seconds 00000100:00100000:0.0:1790945446.182494:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273602432 00000100:00100000:0.0:1790945446.182499:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273602432 00000100:00100000:0.0:1790945446.182529:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790945446.182536:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273602432:12345-0@lo:501: 00000100:00100000:0.0:1790945446.182834:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273602432:12345-0@lo:501: Request processed in 298us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945446.182842:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790945446.182989:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273602432:0@lo:501: 00000100:00100000:2.0:1790945446.183019:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273602560:0@lo:503: 00000100:00100000:2.0:1790945446.183055:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945446.183226:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273602560 00000100:00100000:3.0:1790945446.183231:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273602560 00000100:00100000:3.0:1790945446.183263:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790945446.183270:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273602560:12345-0@lo:503: 00000100:00100000:2.0:1790945446.184213:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c2300 going to sleep for 11 seconds 00000100:00100000:3.0:1790945446.187088:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273602560:12345-0@lo:503: Request processed in 3810us (4023us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.187102:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790945446.187979:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273602560:0@lo:503: 00000100:00100000:1.0:1790945446.188952:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8455:1877942273602688:0@lo:502: 00000100:00100000:1.0:1790945446.189020:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945446.189062:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fb900 going to sleep for 11 seconds 00000100:00100000:3.0:1790945446.189229:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273602688 00000100:00100000:3.0:1790945446.189237:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273602688 00000100:00100000:3.0:1790945446.189286:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790945446.189295:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:8455:x1877942273602688:12345-0@lo:502: 00000100:00100000:3.0:1790945446.189526:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:8455:x1877942273602688:12345-0@lo:502: Request processed in 232us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.189534:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790945446.189745:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8455:1877942273602688:0@lo:502: 00000020:01000000:1.0:1790945446.189776:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945446.189786:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945446.189789:0:8455:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790945446.189795:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790945446.189821:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8455:1877942273602816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945446.189856:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945446.189888:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fb900 going to sleep for 11 seconds 00000100:00100000:0.0:1790945446.190031:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273602816 00000100:00100000:0.0:1790945446.190036:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273602816 00000100:00100000:0.0:1790945446.190070:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790945446.190087:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:8455:x1877942273602816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945446.190222:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:8455:x1877942273602816:12345-0@lo:502:llog_process_th.0 Request processed in 146us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945446.190229:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790945446.190591:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8455:1877942273602816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945446.190616:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945446.190623:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945446.190625:0:8455:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790945446.190631:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1790945446.190742:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1790945446.190776:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790945446.190786:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.190796:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945446.190805:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790945446.190807:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bb8654d2800 from 39 10000000:01000000:2.0:1790945446.190810:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945446.190836:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.190844:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.190862:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945446.190878:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273602944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790945446.190921:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945446.190936:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945446.191225:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273602944 00000100:00100000:3.0:1790945446.191230:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273602944 00000100:00100000:3.0:1790945446.191259:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790945446.191265:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:5820:x1877942273602944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945446.191276:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945446.191287:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f1f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f1ee expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.191306:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f1f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f1ee expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.191315:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f1f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f1ee expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.191323:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8414a7e00, rc 0) 00000100:00100000:3.0:1790945446.191378:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273602944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.191384:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790945446.191587:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273602944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945446.191601:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.191608:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945446.191651:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273603072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945446.191713:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945446.191732:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945446.191832:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273603072 00000100:00100000:1.0:1790945446.191836:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273603072 00000100:00100000:1.0:1790945446.191855:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790945446.191861:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273603072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945446.192237:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273603072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945446.192245:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790945446.192309:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273603072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945446.192352:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273603200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945446.192388:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945446.192415:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945446.192566:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273603200 00000100:00100000:0.0:1790945446.192571:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273603200 00000100:00100000:0.0:1790945446.192591:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790945446.192597:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273603200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945446.192786:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273603200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945446.192799:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790945446.193647:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273603200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945446.197793:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8456:1877942273603328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945446.197885:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945446.197939:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945446.198017:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273603328 00000100:00100000:0.0:1790945446.198026:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273603328 00000100:00100000:0.0:1790945446.198077:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790945446.198086:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:8456:x1877942273603328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945446.198356:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:8456:x1877942273603328:12345-0@lo:502:llog_process_th.0 Request processed in 270us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945446.198364:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790945446.198804:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8456:1877942273603328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945446.198854:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8456:1877942273603456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945446.198888:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945446.198925:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945446.203831:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273603456 00000100:00100000:0.0:1790945446.203849:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273603456 00000100:00100000:0.0:1790945446.203922:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790945446.203934:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:8456:x1877942273603456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945446.204251:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:8456:x1877942273603456:12345-0@lo:502:llog_process_th.0 Request processed in 318us (5361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945446.204259:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790945446.204394:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8456:1877942273603456:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790945446.204439:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790945446.204905:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790945446.204929:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790945446.204942:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945446.204955:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945446.204965:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790945446.204968:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1790945446.204972:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790945446.205005:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945446.205022:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945446.205033:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945446.205055:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273603584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790945446.205204:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945446.205320:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b5669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945446.211643:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273603584 00000100:00100000:2.0:1790945446.211683:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273603584 00000100:00100000:2.0:1790945446.211755:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790945446.211766:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:5820:x1877942273603584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945446.211784:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945446.211803:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8434ae800/0xc5cf2c2a6a54f203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f1fc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.211832:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8434ae800/0xc5cf2c2a6a54f203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f1fc expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.211845:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8434ae800/0xc5cf2c2a6a54f203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f1fc expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.211855:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434ae800, rc 0) 00000100:00100000:2.0:1790945446.211942:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273603584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (6738us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945446.211950:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790945446.212012:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273603584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945446.212030:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.212051:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945446.212145:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273603712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945446.212179:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945446.212208:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945446.212221:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273603712 00000100:00100000:2.0:1790945446.212224:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273603712 00000100:00100000:2.0:1790945446.212241:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790945446.212246:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273603712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945446.212494:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273603712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945446.212502:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790945446.212533:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273603712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945446.212558:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273603840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945446.212594:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945446.212608:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945446.212621:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273603840 00000100:00100000:2.0:1790945446.212624:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273603840 00000100:00100000:2.0:1790945446.212640:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790945446.212645:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273603840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945446.212818:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273603840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945446.212826:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790945446.212861:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273603840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945446.232397:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8457:1877942273603968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945446.232494:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945446.232541:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b566e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945446.233257:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273603968 00000100:00100000:2.0:1790945446.233266:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273603968 00000100:00100000:2.0:1790945446.233308:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790945446.233319:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:8457:x1877942273603968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945446.233576:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:8457:x1877942273603968:12345-0@lo:502:llog_process_th.0 Request processed in 258us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945446.233584:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790945446.234002:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8457:1877942273603968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790945446.234037:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945446.234047:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945446.234050:0:8457:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790945446.234056:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790945446.234101:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8457:1877942273604096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945446.234146:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945446.234219:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b566e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945446.237265:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273604096 00000100:00100000:2.0:1790945446.237280:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273604096 00000100:00100000:2.0:1790945446.237340:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790945446.237349:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:8457:x1877942273604096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945446.237591:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:8457:x1877942273604096:12345-0@lo:502:llog_process_th.0 Request processed in 243us (3444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945446.237599:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790945446.238271:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8457:1877942273604096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790945446.238309:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945446.238317:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945446.238319:0:8457:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790945446.238324:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1790945446.241692:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1790945446.242232:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790945446.242245:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.242258:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945446.242269:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790945446.242272:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bb845514800 from 39 10000000:01000000:2.0:1790945446.242275:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945446.242317:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.242352:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.242364:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945446.242392:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273604224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790945446.242461:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945446.242496:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790945446.242562:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273604224 00000100:00100000:3.0:1790945446.242570:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273604224 00000100:00100000:3.0:1790945446.242619:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790945446.242628:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273604224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945446.242641:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945446.242652:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f211 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f20a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.242770:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f20a expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.242781:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f20a expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.242802:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8414a7c00, rc 0) 00000100:00100000:3.0:1790945446.242847:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273604224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.242854:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790945446.244447:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273604224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945446.244473:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.244484:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945446.244556:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273604352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945446.244606:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945446.244644:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843442780 going to sleep for 11 seconds 00000100:00100000:0.0:1790945446.244729:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273604352 00000100:00100000:0.0:1790945446.244746:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273604352 00000100:00100000:0.0:1790945446.244780:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790945446.244787:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273604352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945446.245061:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273604352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945446.245068:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790945446.245456:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273604352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945446.245491:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273604480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945446.245534:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945446.245566:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843442780 going to sleep for 11 seconds 00000100:00100000:0.0:1790945446.249690:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273604480 00000100:00100000:0.0:1790945446.249716:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273604480 00000100:00100000:0.0:1790945446.249787:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790945446.249796:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273604480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945446.250327:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273604480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945446.250598:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8458:1877942273604608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945446.250643:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945446.250689:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273604608 00000100:00100000:3.0:1790945446.250694:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273604608 00000100:00100000:3.0:1790945446.250735:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790945446.250741:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:8458:x1877942273604608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945446.250917:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:8458:x1877942273604608:12345-0@lo:502:llog_process_th.0 Request processed in 176us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.250925:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790945446.250974:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843442780 going to sleep for 11 seconds 00000100:00100000:3.0:1790945446.250987:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8458:1877942273604608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945446.251020:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8458:1877942273604736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945446.251051:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945446.251069:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273604736 00000100:00100000:3.0:1790945446.251072:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273604736 00000100:00100000:3.0:1790945446.251102:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790945446.251107:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:8458:x1877942273604736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945446.251216:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:8458:x1877942273604736:12345-0@lo:502:llog_process_th.0 Request processed in 108us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.251223:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790945446.251249:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb852096540 going to sleep for 11 seconds 00000100:00100000:3.0:1790945446.251259:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8458:1877942273604736:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790945446.251275:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790945446.251318:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1790945446.251332:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790945446.251341:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.251354:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945446.251376:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790945446.251379:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1790945446.251382:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790945446.251408:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.251416:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.251426:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945446.251439:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273604864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790945446.251465:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945446.251478:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb852096540 going to sleep for 11 seconds 00000100:00100000:3.0:1790945446.251489:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273604864 00000100:00100000:3.0:1790945446.251493:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273604864 00000100:00100000:3.0:1790945446.251509:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790945446.251514:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273604864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945446.251522:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945446.251534:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8821c5200/0xc5cf2c2a6a54f21f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f218 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.251554:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c5200/0xc5cf2c2a6a54f21f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f218 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.251563:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8821c5200/0xc5cf2c2a6a54f21f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f218 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.251586:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c5200, rc 0) 00000100:00100000:3.0:1790945446.251613:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273604864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.251619:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790945446.251644:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273604864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945446.251679:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945446.251687:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945446.251724:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273604992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945446.251748:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945446.251760:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb852096540 going to sleep for 11 seconds 00000100:00100000:3.0:1790945446.251770:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273604992 00000100:00100000:3.0:1790945446.251773:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273604992 00000100:00100000:3.0:1790945446.251788:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790945446.251792:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273604992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945446.252005:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273604992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.252012:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790945446.252040:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273604992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945446.252067:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273605120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945446.252103:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945446.252123:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb852096540 going to sleep for 11 seconds 00000100:00100000:3.0:1790945446.252136:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273605120 00000100:00100000:3.0:1790945446.252140:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273605120 00000100:00100000:3.0:1790945446.252155:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790945446.252160:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273605120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945446.252273:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273605120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.252279:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790945446.252311:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273605120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945446.252852:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273604480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 283us (4542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945446.252862:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790945446.253294:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8459:1877942273605248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945446.253361:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945446.253400:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945446.253478:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273605248 00000100:00100000:0.0:1790945446.253484:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273605248 00000100:00100000:0.0:1790945446.253517:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790945446.253524:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:8459:x1877942273605248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945446.253741:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:8459:x1877942273605248:12345-0@lo:502:llog_process_th.0 Request processed in 217us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945446.253748:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790945446.253964:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8459:1877942273605248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790945446.253991:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945446.254000:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945446.254002:0:8459:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790945446.254009:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790945446.254031:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8459:1877942273605376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945446.254063:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945446.254099:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945446.257135:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273605376 00000100:00100000:0.0:1790945446.257150:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273605376 00000100:00100000:0.0:1790945446.257208:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790945446.257218:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:8459:x1877942273605376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945446.257529:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:8459:x1877942273605376:12345-0@lo:502:llog_process_th.0 Request processed in 311us (3464us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945446.257546:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790945446.261757:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8459:1877942273605376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790945446.261807:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945446.261820:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945446.261823:0:8459:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790945446.261829:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1790945446.262065:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1790945446.262099:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790945446.262111:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945446.262123:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945446.262133:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790945446.262136:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bb8656099c0 from 1 10000000:01000000:0.0:1790945446.262139:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790945446.262181:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1dc00/0xc5cf2c2a6a54f226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945446.262189:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb865d1dc00/0xc5cf2c2a6a54f226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945446.262198:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb865d1dc00/0xc5cf2c2a6a54f226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945446.262221:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273605504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790945446.262287:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945446.262319:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b5663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945446.262599:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273605504 00000100:00100000:1.0:1790945446.262608:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273605504 00000100:00100000:1.0:1790945446.262685:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790945446.262694:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273605504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945446.262717:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945446.262730:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f22d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f226 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945446.262751:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f22d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f226 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945446.262761:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f22d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f226 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945446.262785:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167ba00, rc 0) 00000100:00100000:1.0:1790945446.262833:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273605504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945446.262840:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790945446.262995:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273605504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945446.263011:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb865d1dc00/0xc5cf2c2a6a54f226 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f22d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.263021:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb865d1dc00/0xc5cf2c2a6a54f226 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f22d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945446.263094:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273605632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945446.263124:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945446.263154:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945446.263295:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273605632 00000100:00100000:1.0:1790945446.263301:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273605632 00000100:00100000:1.0:1790945446.263330:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790945446.263346:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273605632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945446.263576:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273605632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (450us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790945446.263584:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790945446.263728:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273605632:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1790945446.263753:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790945446.263761:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1dc00/0xc5cf2c2a6a54f226 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f22d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945446.263770:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865d1dc00/0xc5cf2c2a6a54f226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f22d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945446.488258:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945446.489471:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254703360 00000100:00100000:1.0:1790945446.489484:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254703360 00000100:00100000:1.0:1790945446.489557:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 165 00000100:00100000:1.0:1790945446.489567:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+8:5615:x1877942254703360:12345-192.168.202.48@tcp:101: 00010000:00010000:1.0:1790945446.489585:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945446.489603:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f234 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c806c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945446.489634:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c806c expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945446.489647:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c806c expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945446.489693:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167bc00, rc 0) 00000100:00100000:1.0:1790945446.489790:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+9:5615:x1877942254703360:12345-192.168.202.48@tcp:101: Request processed in 223us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945446.489798:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 165 00000100:00100000:0.0:1790945446.498837:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945446.498964:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254703488 00000100:00100000:1.0:1790945446.498974:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254703488 00000100:00100000:1.0:1790945446.499240:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 166 00000100:00100000:1.0:1790945446.499251:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+9:5615:x1877942254703488:12345-192.168.202.48@tcp:501: 00000100:00100000:1.0:1790945446.499922:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+9:5615:x1877942254703488:12345-192.168.202.48@tcp:501: Request processed in 671us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945446.499932:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 166 00000100:00100000:0.0:1790945446.512276:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945446.514467:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254703616 00000100:00100000:3.0:1790945446.514483:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254703616 00000100:00100000:3.0:1790945446.514559:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 167 00000100:00100000:3.0:1790945446.514570:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+9:5615:x1877942254703616:12345-192.168.202.48@tcp:503: 00000100:00100000:3.0:1790945446.514855:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+9:5615:x1877942254703616:12345-192.168.202.48@tcp:503: Request processed in 286us (2588us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.514863:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 167 00000100:00100000:3.0:1790945446.522815:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945446.527647:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254703744 00000100:00100000:1.0:1790945446.527677:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254703744 00000100:00100000:0.0:1790945446.528447:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 168 00000100:00100000:0.0:1790945446.528460:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+9:6086:x1877942254703744:12345-192.168.202.48@tcp:502: 00000100:00100000:0.0:1790945446.530667:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+9:6086:x1877942254703744:12345-192.168.202.48@tcp:502: Request processed in 2168us (8933us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945446.530681:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 168 00000100:00100000:0.0:1790945446.553539:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945446.553655:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254703872 00000100:00100000:3.0:1790945446.553692:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254703872 00000100:00100000:3.0:1790945446.553749:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 169 00000100:00100000:3.0:1790945446.553759:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+9:6086:x1877942254703872:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790945446.554049:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+9:6086:x1877942254703872:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 290us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945446.554058:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 169 00000100:00100000:3.0:1790945446.581051:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945446.581348:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254704000 00000100:00100000:0.0:1790945446.581359:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254704000 00000100:00100000:0.0:1790945446.581413:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 170 00000100:00100000:0.0:1790945446.581423:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+9:5615:x1877942254704000:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945446.581441:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945446.581458:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865d1d000/0xc5cf2c2a6a54f23b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8073 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945446.581485:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1d000/0xc5cf2c2a6a54f23b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8073 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945446.581497:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865d1d000/0xc5cf2c2a6a54f23b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8073 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945446.581507:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d000, rc 0) 00000100:00100000:0.0:1790945446.581626:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+10:5615:x1877942254704000:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 203us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945446.581633:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 170 00000100:00100000:0.0:1790945446.597774:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945446.597871:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254704128 00000100:00100000:1.0:1790945446.597882:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254704128 00000100:00100000:1.0:1790945446.597950:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 171 00000100:00100000:1.0:1790945446.597962:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+10:5615:x1877942254704128:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945446.598244:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+10:5615:x1877942254704128:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 284us (478us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790945446.598254:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 171 00010000:00010000:0.0:1790945446.619969:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945447.644800:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945447.716351:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945447.716385:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273605760:0@lo:400:kworker.0 00000100:00100000:3.0:1790945447.718962:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273606016:0@lo:400:kworker.0 00000100:00100000:2.0:1790945447.719140:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273606272:0@lo:400:kworker.0 00000100:00100000:3.0:1790945447.720184:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945447.720267:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945447.720277:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273606144:0@lo:400:kworker.0 00000100:00100000:3.0:1790945447.720312:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945447.720414:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273606016 00000100:00100000:1.0:1790945447.720425:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273606016 00000100:00100000:1.0:1790945447.720508:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790945447.720520:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273606016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945447.720594:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273606016:12345-0@lo:400:kworker.0 Request processed in 77us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945447.720602:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790945447.720644:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273606144 00000100:00100000:1.0:1790945447.720647:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273606144 00000100:00100000:1.0:1790945447.720692:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790945447.720698:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273606144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945447.720730:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273606144:12345-0@lo:400:kworker.0 Request processed in 33us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945447.720737:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1790945447.720782:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f8d500 x1877942273606144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945447.720799:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273606144:0@lo:400:kworker.0 00000100:00100000:1.0:1790945447.720811:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273606016:0@lo:400:kworker.0 00000100:00100000:2.0:1790945447.720994:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945447.721035:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790945447.721045:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273605888:0@lo:400:kworker.0 00000100:00100000:2.0:1790945447.721072:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945447.721091:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273606400:0@lo:400:kworker.0 00000100:00100000:2.0:1790945447.721113:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945447.721152:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273606400 00000100:00100000:2.0:1790945447.721157:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273606400 00000100:00100000:2.0:1790945447.721186:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790945447.721193:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273606400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945447.721232:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273606400:12345-0@lo:400:kworker.0 Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945447.721238:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1790945447.721268:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f8dc00 x1877942273606400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945447.721278:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273606400:0@lo:400:kworker.0 00000100:00100000:1.0:1790945447.721359:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273606272 00000100:00100000:1.0:1790945447.721363:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273606272 00000100:00100000:1.0:1790945447.721395:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273605888 00000100:00100000:1.0:1790945447.721398:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273605888 00000100:00100000:1.0:1790945447.721417:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790945447.721423:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273606272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945447.721478:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273606272:12345-0@lo:400:kworker.0 Request processed in 54us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945447.721485:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790945447.721496:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790945447.721502:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273605888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945447.721531:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273605888:12345-0@lo:400:kworker.0 Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945447.721538:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790945447.721737:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273605888:0@lo:400:kworker.0 00000100:00100000:2.0:1790945447.721747:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273606272:0@lo:400:kworker.0 00000100:00100000:0.0:1790945447.721747:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945447.721797:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273605760 00000100:00080000:0.0:1790945447.721807:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945447.721808:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273605760 00000100:00080000:0.0:1790945447.721813:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945447.721815:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945447.721842:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790945447.721849:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273605760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945447.721911:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273605760:12345-0@lo:400:kworker.0 Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945447.721918:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790945447.721980:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273605760:0@lo:400:kworker.0 00000020:00000080:0.0:1790945448.040142:0:8496:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4b35de00 20000000:00000080:0.0:1790945448.040166:0:8496:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb87fe8b400 uarg=0000000000000000 20000000:01000000:0.0:1790945448.040277:0:8496:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790945448.040284:0:8496:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790945448.040290:0:8496:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790945448.042232:0:8497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1790945448.042428:0:8496:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1790945448.046603:0:8496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1790945448.046715:0:8496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1790945448.046781:0:8496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1790945448.046802:0:8496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790945448.046828:0:8496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945448.046851:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb84167be00/0xc5cf2c2a6a54efb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54efb0 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945448.046860:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8821c5800/0xc5cf2c2a6a54f019 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f012 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945448.046868:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f0dd expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945448.046888:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb840030000/0xc5cf2c2a6a54f1a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c803b expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945448.046897:0:8496:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945448.046952:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb840030000/0xc5cf2c2a6a54f1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c803b expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945448.046986:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb840030000/0xc5cf2c2a6a54f1a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c803b expref: 9 pid: 5817 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945448.047006:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1877942273606528:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945448.047146:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0dd expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945448.047155:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0dd expref: 18 pid: 5817 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945448.047167:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1877942273606656:0@lo:104: 00000100:00100000:1.0:1790945448.047337:0:8496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790945448.047610:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8821c5800/0xc5cf2c2a6a54f019 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f012 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945448.047620:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8821c5800/0xc5cf2c2a6a54f019 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f012 expref: 18 pid: 5815 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945448.047629:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1877942273606784:0@lo:104: 00000100:00100000:1.0:1790945448.047693:0:8496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790945448.048311:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb84167be00/0xc5cf2c2a6a54efb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54efb0 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945448.048323:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb84167be00/0xc5cf2c2a6a54efb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54efb0 expref: 18 pid: 5817 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945448.048333:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1877942273606912:0@lo:104: 00000100:00100000:1.0:1790945448.048359:0:8496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fb900 going to sleep for 11 seconds 00000100:00100000:3.0:1790945448.052149:0:5806:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790945448.052221:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945448.052259:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273606656 00000100:00100000:3.0:1790945448.052271:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273606656 00000100:00100000:3.0:1790945448.052336:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273606784 00000100:00100000:3.0:1790945448.052340:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273606784 00000100:00100000:3.0:1790945448.052352:0:5806:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273606912 00000100:00100000:3.0:1790945448.052354:0:5806:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273606912 00000100:00100000:3.0:1790945448.052367:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790945448.052377:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+5:8496:x1877942273606656:12345-0@lo:104: 00010000:00010000:3.0:1790945448.052399:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f0e4 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.052491:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790945448.052498:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+5:8496:x1877942273606656:12345-0@lo:104: Request processed in 123us (5162us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945448.052506:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790945448.052526:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790945448.052533:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fed2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:8496:x1877942273606784:12345-0@lo:104: 00010000:00010000:3.0:1790945448.052541:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f019 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.052578:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790945448.052596:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fed2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:8496:x1877942273606784:12345-0@lo:104: Request processed in 63us (4902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945448.052602:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1790945448.052672:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790945448.052680:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f0e4 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.052688:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4800 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1790945448.052693:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f0e4 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.052703:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f0e4 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945448.052711:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f0e4 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945448.052718:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790945448.052760:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f0e4 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.052767:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945448.052792:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f0e4 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.052799:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f0dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f0e4 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.052815:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945448.052818:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f019 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.052835:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167b400 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1790945448.052838:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f019 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.052934:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f019 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945448.052979:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f019 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945448.052986:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790945448.053000:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f019 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.053006:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945448.053013:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f019 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.053019:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb84167b400/0xc5cf2c2a6a54f012 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f019 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.053029:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945448.053031:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945448.053033:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945448.053060:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273607040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945448.053102:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945448.053145:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945448.053151:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273607168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945448.053184:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945448.053214:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273607040 00000100:00100000:3.0:1790945448.053219:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273607040 00010000:00010000:3.0:1790945448.053242:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0dd expref: 19 pid: 5817 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945448.053265:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273607168 00000100:00100000:3.0:1790945448.053268:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273607168 00010000:00010000:3.0:1790945448.053280:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8821c5800/0xc5cf2c2a6a54f019 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f012 expref: 20 pid: 5815 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945448.053296:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790945448.053302:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+20:3292:x1877942273607040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790945448.053313:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945448.053318:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0dd expref: 20 pid: 5817 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.053328:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0dd expref: 20 pid: 5817 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.053348:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945448.053372:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+20:3292:x1877942273607040:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945448.053378:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790945448.053390:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790945448.053395:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273607168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790945448.053401:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945448.053405:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8821c5800/0xc5cf2c2a6a54f019 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f012 expref: 19 pid: 5815 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.053424:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8821c5800/0xc5cf2c2a6a54f019 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f012 expref: 19 pid: 5815 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.053433:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945448.053451:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273607168:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945448.053457:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790945448.053493:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273607168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945448.053501:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273607040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945448.053529:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790945448.053536:0:5806:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:8496:x1877942273606912:12345-0@lo:104: 00010000:00010000:3.0:1790945448.053546:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a54efb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54efb7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.053579:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790945448.053584:0:5806:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:8496:x1877942273606912:12345-0@lo:104: Request processed in 49us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945448.053589:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1790945448.053602:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945448.053606:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a54efb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54efb7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.053613:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5600 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1790945448.053616:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a54efb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54efb7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.053634:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a54efb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54efb7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945448.053640:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a54efb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54efb7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945448.053646:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790945448.053687:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a54efb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54efb7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.053694:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945448.053712:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a54efb0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54efb7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.053719:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a54efb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54efb7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.053734:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945448.053736:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945448.053738:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945448.054052:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb840031400/0xc5cf2c2a6a54f0e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f0dd expref: 18 pid: 5817 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945448.054080:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1877942273606656:0@lo:104: 00010000:00010000:1.0:1790945448.054093:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c5800/0xc5cf2c2a6a54f019 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f012 expref: 17 pid: 5815 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945448.054100:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1877942273606784:0@lo:104: 00000100:00100000:1.0:1790945448.054108:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1877942273606912:0@lo:104: 00000100:00100000:0.0:1790945448.054444:0:5807:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:0.0:1790945448.054464:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945448.054476:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945448.054488:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273607296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945448.054529:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945448.054611:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273607296 00000100:00100000:3.0:1790945448.054616:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273607296 00010000:00010000:3.0:1790945448.057957:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb84167be00/0xc5cf2c2a6a54efb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54efb0 expref: 17 pid: 5817 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945448.058333:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790945448.058354:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:3295:x1877942273607296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790945448.058376:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945448.058382:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb84167be00/0xc5cf2c2a6a54efb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54efb0 expref: 17 pid: 5817 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.058414:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb84167be00/0xc5cf2c2a6a54efb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54efb0 expref: 17 pid: 5817 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.058437:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167be00/0xc5cf2c2a6a54efb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54efb0 expref: 17 pid: 5817 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.058457:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945448.058548:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:3295:x1877942273607296:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (4018us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945448.058556:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790945448.058621:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273607296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945448.059348:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1877942273606528:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945448.059387:0:8496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945448.060554:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945448.060844:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254704256 00000100:00100000:0.0:1790945448.060857:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254704256 00010000:00010000:0.0:1790945448.060910:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb840030000/0xc5cf2c2a6a54f1a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c803b expref: 10 pid: 5817 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945448.060948:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 24 00000100:00100000:0.0:1790945448.060959:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee3b157-ad31-4030-99ec-031c727e7689+10:2372:x1877942254704256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945448.060975:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945448.060981:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb840030000/0xc5cf2c2a6a54f1a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c803b expref: 10 pid: 5817 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945448.060994:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb840030000/0xc5cf2c2a6a54f1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c803b expref: 10 pid: 5817 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945448.061030:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb840030000/0xc5cf2c2a6a54f1a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c803b expref: 10 pid: 5817 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945448.061049:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945448.061069:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945448.061090:0:8440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945448.061098:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945448.061106:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945448.061126:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945448.061134:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167a600 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945448.061139:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945448.061149:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945448.061167:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945448.061308:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945448.061373:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bee3b157-ad31-4030-99ec-031c727e7689+9:2372:x1877942254704256:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 415us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945448.061382:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 24 00010000:00010000:2.0:1790945448.062342:0:8496:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945448.062357:0:8496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945448.062365:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167a600/0xc5cf2c2a6a54f242 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945448.219965:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273607424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945448.220062:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945448.220172:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273607424 00000100:00100000:0.0:1790945448.220183:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273607424 00000100:00100000:0.0:1790945448.220244:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790945448.220256:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273607424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945448.220304:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945448.220356:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273607424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945448.220363:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1790945448.220409:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88133fb80 x1877942273607424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945448.220430:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273607424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945448.221314:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945448.221347:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254704384 00000100:00100000:3.0:1790945448.221354:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254704384 00000100:00100000:3.0:1790945448.221397:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 173 00000100:00100000:3.0:1790945448.221406:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+9:5615:x1877942254704384:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945448.221422:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945448.221449:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8821c5600/0xc5cf2c2a6a54f249 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c807a expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.221482:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c5600/0xc5cf2c2a6a54f249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c807a expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.221494:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8821c5600/0xc5cf2c2a6a54f249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c807a expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945448.221516:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c5600, rc 0) 00000100:00100000:3.0:1790945448.221573:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+10:5615:x1877942254704384:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 168us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945448.221580:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 173 00000100:00100000:3.0:1790945448.226185:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945448.227935:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273607552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945448.228022:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945448.228097:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273607552 00000100:00100000:2.0:1790945448.228118:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273607552 00000100:00100000:2.0:1790945448.228179:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790945448.228190:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273607552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945448.228236:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945448.228289:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273607552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945448.228297:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1790945448.228344:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87acfc380 x1877942273607552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945448.228365:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273607552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945448.230029:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254704512 00000100:00100000:0.0:1790945448.230045:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254704512 00000100:00100000:3.0:1790945448.230200:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 174 00000100:00100000:3.0:1790945448.230215:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+10:5615:x1877942254704512:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945448.230602:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+10:5615:x1877942254704512:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 390us (4495us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945448.230611:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 174 00000100:00100000:3.0:1790945448.237109:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945448.237227:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254704640 00000100:00100000:2.0:1790945448.237238:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254704640 00000100:00100000:2.0:1790945448.237347:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 175 00000100:00100000:2.0:1790945448.237363:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:5615:x1877942254704640:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945448.237584:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:5615:x1877942254704640:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 229us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945448.237592:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 175 00000100:00100000:2.0:1790945448.244518:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945448.244941:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254704768 00000100:00100000:3.0:1790945448.244953:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254704768 00000100:00100000:3.0:1790945448.245026:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 176 00000100:00100000:3.0:1790945448.245040:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+10:6122:x1877942254704768:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790945448.245318:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+10:6122:x1877942254704768:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 282us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945448.245327:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 176 00000100:00100000:3.0:1790945448.248954:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945448.249133:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254704896 00000100:00100000:0.0:1790945448.249143:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254704896 00000100:00100000:0.0:1790945448.249221:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 177 00000100:00100000:0.0:1790945448.249230:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+10:6122:x1877942254704896:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790945448.249449:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+10:6122:x1877942254704896:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 219us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945448.249466:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 177 00010000:00010000:0.0:1790945448.676800:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945449.692207:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790945449.891200:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790945449.891208:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb87fbcd800 from 4 10000000:01000000:0.0:1790945449.891213:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790945449.891257:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945449.891270:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945449.891282:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945449.891308:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273607680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790945449.891374:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945449.891437:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb844ec49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945449.891506:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273607680 00000100:00100000:1.0:1790945449.891514:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273607680 00000100:00100000:1.0:1790945449.891565:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790945449.891574:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273607680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945449.891589:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945449.891602:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54f257 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f250 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945449.891626:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54f257 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f250 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945449.891636:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54f257 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f250 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945449.891644:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167b400, rc 0) 00000100:00100000:1.0:1790945449.891704:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273607680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945449.891711:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790945449.891750:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273607680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945449.891776:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f257 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945449.891785:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f257 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945449.891842:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273607808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945449.891878:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945449.891891:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb851fac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945449.892912:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273607808 00000100:00100000:0.0:1790945449.892920:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273607808 00000100:00100000:0.0:1790945449.892955:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790945449.892962:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273607808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945449.893261:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273607808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945449.893269:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790945449.894109:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273607808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945449.894166:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273607936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945449.894217:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945449.894257:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb851fac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945449.895236:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273607936 00000100:00100000:0.0:1790945449.895246:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273607936 00000100:00100000:0.0:1790945449.895297:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790945449.895316:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273607936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945449.895515:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273607936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945449.895523:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1790945449.895669:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273607936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945449.896039:0:8602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8602:1877942273608064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945449.896082:0:8602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945449.896126:0:8602:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb851fac840 going to sleep for 11 seconds 00000100:00100000:0.0:1790945449.896221:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273608064 00000100:00100000:0.0:1790945449.896226:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273608064 00000100:00100000:0.0:1790945449.896256:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1790945449.896264:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:8602:x1877942273608064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945449.896398:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:8602:x1877942273608064:12345-0@lo:502:llog_process_th.0 Request processed in 134us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945449.896405:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1790945449.896469:0:8602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8602:1877942273608064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945449.896490:0:8602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945449.896499:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945449.896501:0:8602:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790945449.896507:0:8602:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb87fbcd800 00000020:00000080:2.0:1790945449.896510:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790945449.896585:0:8602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8602:1877942273608192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945449.896617:0:8602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945449.896639:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273608192 00000100:00100000:2.0:1790945449.896642:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273608192 00000100:00100000:2.0:1790945449.896689:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790945449.896695:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:8602:x1877942273608192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945449.896797:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:8602:x1877942273608192:12345-0@lo:502:llog_process_th.0 Request processed in 102us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945449.896804:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790945449.896835:0:8602:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c2240 going to sleep for 11 seconds 00000100:00100000:2.0:1790945449.896846:0:8602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8602:1877942273608192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945449.896875:0:8602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945449.896880:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945449.896881:0:8602:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790945449.896890:0:8602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790945449.896941:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790945449.896958:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945449.896967:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f257 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945449.896979:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f257 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945449.896988:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790945449.896991:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb8654d2800 from 4 10000000:01000000:2.0:1790945449.896994:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790945449.897015:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945449.897024:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945449.897033:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945449.897045:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273608320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790945449.897070:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945449.897086:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c2240 going to sleep for 11 seconds 00000100:00100000:0.0:1790945449.899010:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273608320 00000100:00100000:0.0:1790945449.899021:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273608320 00000100:00100000:0.0:1790945449.899060:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1790945449.899069:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273608320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945449.899083:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945449.899796:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865d1c400/0xc5cf2c2a6a54f265 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f25e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945449.899826:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1c400/0xc5cf2c2a6a54f265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f25e expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945449.899839:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865d1c400/0xc5cf2c2a6a54f265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f25e expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945449.899848:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c400, rc 0) 00000100:00100000:0.0:1790945449.900015:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273608320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 946us (2943us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945449.900031:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1790945449.908003:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273608320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945449.908034:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945449.908047:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945449.908158:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273608448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945449.908221:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945449.908269:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c2240 going to sleep for 11 seconds 00000100:00100000:0.0:1790945449.908352:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273608448 00000100:00100000:0.0:1790945449.908360:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273608448 00000100:00100000:0.0:1790945449.908413:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1790945449.908423:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273608448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945449.908683:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273608448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945449.908691:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1790945449.908781:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273608448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945449.908809:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273608576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945449.908844:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945449.908880:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8814c2240 going to sleep for 11 seconds 00000100:00100000:0.0:1790945449.908916:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273608576 00000100:00100000:0.0:1790945449.908920:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273608576 00000100:00100000:0.0:1790945449.908948:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1790945449.908954:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273608576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945449.909267:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273608576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 312us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945449.909274:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790945449.909340:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273608576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945449.916800:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8606:1877942273608704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945449.916891:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945449.916936:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fba80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945449.916986:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273608704 00000100:00100000:3.0:1790945449.916995:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273608704 00000100:00100000:3.0:1790945449.917043:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1790945449.917053:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:8606:x1877942273608704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945449.917261:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:8606:x1877942273608704:12345-0@lo:502:llog_process_th.0 Request processed in 210us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945449.917274:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1790945449.917359:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8606:1877942273608704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790945449.917387:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945449.917397:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945449.917400:0:8606:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790945449.917407:0:8606:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb8654d2800 00000020:00000080:0.0:1790945449.917410:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790945449.917464:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8606:1877942273608832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945449.917503:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945449.917522:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273608832 00000100:00100000:0.0:1790945449.917525:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273608832 00000100:00100000:0.0:1790945449.917553:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1790945449.917560:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:8606:x1877942273608832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945449.917693:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:8606:x1877942273608832:12345-0@lo:502:llog_process_th.0 Request processed in 132us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945449.917700:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1790945449.917727:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fba80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945449.917738:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8606:1877942273608832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790945449.917754:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945449.917758:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945449.917760:0:8606:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790945449.917764:0:8606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790945449.917906:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790945449.917926:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790945449.917937:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945449.917948:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945449.917959:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790945449.917962:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb845514800 from 4 10000000:01000000:3.0:1790945449.917965:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790945449.917989:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945449.917997:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945449.918006:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945449.918019:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273608960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790945449.918046:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945449.918067:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945449.918108:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273608960 00000100:00100000:0.0:1790945449.918113:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273608960 00000100:00100000:0.0:1790945449.918133:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1790945449.918139:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273608960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945449.918148:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945449.918161:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f273 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f26c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945449.918181:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f26c expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945449.918191:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f26c expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945449.918211:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1da00, rc 0) 00000100:00100000:0.0:1790945449.918245:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273608960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945449.918251:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1790945449.918311:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273608960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945449.918324:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945449.918333:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945449.918384:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273609088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945449.918406:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945449.918426:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945449.918462:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273609088 00000100:00100000:0.0:1790945449.918466:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273609088 00000100:00100000:0.0:1790945449.918484:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1790945449.918490:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273609088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945449.919468:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273609088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 975us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945449.919478:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1790945449.926125:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273609088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945449.926183:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273609216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945449.926253:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945449.926301:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945449.926361:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273609216 00000100:00100000:1.0:1790945449.926368:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273609216 00000100:00100000:1.0:1790945449.926421:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1790945449.926430:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273609216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945449.926616:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273609216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945449.926625:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1790945449.926726:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273609216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945449.927106:0:8608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8608:1877942273609344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945449.927144:0:8608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945449.927174:0:8608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945449.927222:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273609344 00000100:00100000:1.0:1790945449.927227:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273609344 00000100:00100000:1.0:1790945449.927257:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1790945449.927270:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:8608:x1877942273609344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945449.927400:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:8608:x1877942273609344:12345-0@lo:502:llog_process_th.0 Request processed in 130us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945449.927407:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1790945449.927479:0:8608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8608:1877942273609344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790945449.927499:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945449.927509:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945449.927511:0:8608:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790945449.927520:0:8608:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb845514800 00000020:00000080:3.0:1790945449.927522:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790945449.927594:0:8608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8608:1877942273609472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945449.927625:0:8608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945449.927644:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273609472 00000100:00100000:3.0:1790945449.927647:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273609472 00000100:00100000:3.0:1790945449.927706:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1790945449.927713:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:8608:x1877942273609472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945449.927827:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:8608:x1877942273609472:12345-0@lo:502:llog_process_th.0 Request processed in 114us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945449.927834:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1790945449.927859:0:8608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790945449.927880:0:8608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:8608:1877942273609472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790945449.927896:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945449.927900:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945449.927902:0:8608:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790945449.927906:0:8608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790945449.928051:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790945449.928067:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790945449.928076:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945449.928087:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945450.720757:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945451.162028:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945451.162073:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945451.162189:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254705024 00000100:00100000:3.0:1790945451.162199:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254705024 00000100:00100000:3.0:1790945451.162257:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 193 00000100:00100000:3.0:1790945451.162267:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:2370:x1877942254705024:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945451.162340:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:2370:x1877942254705024:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 74us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945451.162349:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 193 00000100:00100000:2.0:1790945451.162545:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254705280 00000100:00100000:2.0:1790945451.162550:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254705280 00000100:00100000:2.0:1790945451.162597:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:2.0:1790945451.162605:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254705280:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945451.162639:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254705280:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 36us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945451.162646:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00080000:1.0:1790945451.162723:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945451.163286:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945451.163321:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945451.163379:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254705408 00000100:00100000:3.0:1790945451.163384:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254705408 00000100:00100000:3.0:1790945451.163425:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:3.0:1790945451.163433:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2371:x1877942254705408:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945451.163469:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2371:x1877942254705408:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 37us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945451.163476:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00080000:1.0:1790945451.163573:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790945451.163726:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254705152 00000100:00100000:2.0:1790945451.163730:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254705152 00000100:00100000:2.0:1790945451.163777:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00100000:2.0:1790945451.163785:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254705152:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945451.163818:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254705152:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 33us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945451.163824:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00080000:1.0:1790945451.163906:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790945451.739926:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945452.764964:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945452.828536:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273609984:0@lo:400:kworker.0 00000100:00100000:0.0:1790945452.828604:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945452.828691:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790945452.828698:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273609600:0@lo:400:kworker.0 00000100:00100000:0.0:1790945452.828729:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945452.828754:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273610112:0@lo:400:kworker.0 00000100:00100000:2.0:1790945452.828768:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273609984 00000100:00100000:0.0:1790945452.828779:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945452.828784:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273609984 00000100:00100000:0.0:1790945452.828803:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273609728:0@lo:400:kworker.0 00000100:00100000:0.0:1790945452.828823:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945452.828851:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790945452.828860:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273609984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945452.828893:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273610240:0@lo:400:kworker.0 00000100:00100000:0.0:1790945452.828915:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945452.828931:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273609984:12345-0@lo:400:kworker.0 Request processed in 73us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945452.828934:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945452.828939:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790945452.828946:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273609856:0@lo:400:kworker.0 00000100:00100000:2.0:1790945452.828954:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273610240 00000100:00100000:2.0:1790945452.828956:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273610240 00000100:00100000:2.0:1790945452.828979:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790945452.828985:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273610240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945452.828987:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945452.835647:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273610240:12345-0@lo:400:kworker.0 Request processed in 6651us (6719us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945452.835678:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1790945452.835727:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945452.835733:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945452.840987:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273609600 00000100:00100000:0.0:1790945452.841016:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273609600 00000100:00100000:0.0:1790945452.841084:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1790945452.841095:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273609600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945452.841181:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273609600:12345-0@lo:400:kworker.0 Request processed in 88us (12450us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945452.841188:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1790945452.841227:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273610112 00000100:00100000:0.0:1790945452.841232:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273610112 00000100:00100000:0.0:1790945452.841267:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273609728 00000100:00100000:0.0:1790945452.841271:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273609728 00000100:00100000:0.0:1790945452.841282:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273609856 00000100:00100000:0.0:1790945452.841284:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273609856 00000100:00100000:0.0:1790945452.841296:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790945452.841301:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273610112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945452.841333:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273610112:12345-0@lo:400:kworker.0 Request processed in 32us (12554us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945452.841340:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790945452.841350:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790945452.841356:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273609728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945452.841384:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273609728:12345-0@lo:400:kworker.0 Request processed in 28us (12560us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945452.841391:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790945452.841401:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790945452.841408:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273609856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945452.841472:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273609856:12345-0@lo:400:kworker.0 Request processed in 65us (12484us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945452.841479:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1790945452.841512:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945452.841543:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273609600:0@lo:400:kworker.0 00000100:00100000:0.0:1790945452.841557:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273610112:0@lo:400:kworker.0 00010000:00080000:0.0:1790945452.841572:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88133df80 x1877942273609984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945452.841581:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273609984:0@lo:400:kworker.0 00000100:00100000:1.0:1790945452.843140:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273609856:0@lo:400:kworker.0 00000100:00100000:1.0:1790945452.843160:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273609728:0@lo:400:kworker.0 00010000:00080000:1.0:1790945452.843174:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88133fb80 x1877942273610240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945452.843184:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273610240:0@lo:400:kworker.0 00000001:02000400:1.0:1790945453.194859:0:8794:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1790945453.339783:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790945453.339807:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273610368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945453.339959:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945453.340190:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273610368 00000100:00100000:0.0:1790945453.340198:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273610368 00000100:00100000:0.0:1790945453.341001:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790945453.341022:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273610368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945453.341134:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945453.341191:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273610368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945453.341199:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1790945453.341375:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88133df80 x1877942273610368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945453.341395:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273610368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945453.342769:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273610496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945453.342826:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945453.342947:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273610496 00000100:00100000:0.0:1790945453.342953:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273610496 00000100:00100000:0.0:1790945453.342986:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790945453.342994:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273610496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790945453.343574:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945453.343635:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273610496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 640us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945453.343642:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1790945453.343988:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88133df80 x1877942273610496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945453.344283:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273610496:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790945453.787888:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945454.812333:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945455.836920:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945456.280174:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945456.280388:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945456.280416:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945456.280450:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945456.280490:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254705664 00000100:00100000:1.0:1790945456.280500:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254705664 00000100:00100000:2.0:1790945456.280519:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254705536 00000100:00100000:2.0:1790945456.280525:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254705536 00000100:00100000:3.0:1790945456.282722:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254705792 00000100:00100000:3.0:1790945456.282740:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254705792 00000100:00100000:3.0:1790945456.282783:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254705920 00000100:00100000:3.0:1790945456.282785:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254705920 00000100:00100000:1.0:1790945456.283547:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 37 00000100:00100000:1.0:1790945456.283566:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254705664:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945456.283671:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 195 00000100:00100000:1.0:1790945456.283674:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254705664:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 96us (3238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945456.284319:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+10:2373:x1877942254705536:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945456.284361:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+10:2373:x1877942254705536:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 679us (4198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945456.284368:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 195 00000100:00100000:3.0:1790945456.284419:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 19 00000100:00100000:3.0:1790945456.284435:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2373:x1877942254705792:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945456.284466:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2373:x1877942254705792:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 38us (4078us total) trans 0 rc 0/0 00000100:00080000:0.0:1790945456.286731:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945456.286740:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945456.286743:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945456.286835:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 37 00000100:00100000:2.0:1790945456.287795:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 20 00000100:00100000:2.0:1790945456.287824:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2373:x1877942254705920:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945456.287864:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 19 00000100:00100000:2.0:1790945456.287901:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2373:x1877942254705920:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 88us (7449us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945456.287917:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 20 00010000:00010000:3.0:1790945456.859866:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790945457.679240:0:9039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing yml_node 00010000:00010000:1.0:1790945457.886125:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945457.950851:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273610624:0@lo:400:kworker.0 00000100:00100000:0.0:1790945457.950889:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273610752:0@lo:400:kworker.0 00000100:00100000:2.0:1790945457.950964:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273611008:0@lo:400:kworker.0 00000100:00100000:3.0:1790945457.951056:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273610880:0@lo:400:kworker.0 00000100:00100000:0.0:1790945457.951243:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945457.951290:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273611264:0@lo:400:kworker.0 00000100:00100000:0.0:1790945457.951329:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945457.951376:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273610752 00000100:00100000:0.0:1790945457.951384:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273610752 00000100:00100000:0.0:1790945457.951426:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790945457.951434:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273610752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945457.951483:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273610752:12345-0@lo:400:kworker.0 Request processed in 49us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945457.951491:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790945457.951530:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273610752:0@lo:400:kworker.0 00000100:00100000:0.0:1790945457.952480:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273611264 00000100:00100000:0.0:1790945457.952497:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273611264 00000100:00100000:0.0:1790945457.952538:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790945457.952546:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273611264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945457.952886:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273611264:12345-0@lo:400:kworker.0 Request processed in 340us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945457.952894:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1790945457.952914:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790945457.952936:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88133c380 x1877942273611264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945457.952949:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273611264:0@lo:400:kworker.0 00000100:00100000:1.0:1790945457.953913:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945457.954235:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273611136:0@lo:400:kworker.0 00000100:00100000:1.0:1790945457.954282:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945457.954363:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273610624 00000100:00100000:1.0:1790945457.954370:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273610624 00000100:00100000:0.0:1790945457.956190:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273611136 00000100:00100000:0.0:1790945457.956200:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273611136 00000100:00100000:1.0:1790945457.956208:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1790945457.956217:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273610624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945457.956239:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790945457.956244:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273611136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945457.956426:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273611136:12345-0@lo:400:kworker.0 Request processed in 181us (2142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945457.956433:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1790945457.956458:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945457.956643:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273610624:12345-0@lo:400:kworker.0 Request processed in 426us (2731us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945457.956675:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1790945457.956680:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945457.956729:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273611136:0@lo:400:kworker.0 00000100:00100000:1.0:1790945457.956740:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273610624:0@lo:400:kworker.0 00000100:00100000:0.0:1790945457.956920:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273611008 00000100:00100000:0.0:1790945457.956924:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273611008 00000100:00100000:0.0:1790945457.957000:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790945457.957006:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273611008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945457.957048:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273611008:12345-0@lo:400:kworker.0 Request processed in 42us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945457.957054:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1790945457.957087:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88133df80 x1877942273611008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945457.957110:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273611008:0@lo:400:kworker.0 00000100:00080000:2.0:1790945457.957232:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945457.957295:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945457.957394:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273610880 00000100:00100000:0.0:1790945457.957400:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273610880 00000100:00100000:0.0:1790945457.957475:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790945457.957481:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273610880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945457.957517:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273610880:12345-0@lo:400:kworker.0 Request processed in 37us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945457.957524:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790945457.957594:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273610880:0@lo:400:kworker.0 00000100:00080000:2.0:1790945457.957780:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945458.459806:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790945458.459828:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273611392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945458.459899:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945458.459976:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273611392 00000100:00100000:0.0:1790945458.459983:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273611392 00000100:00100000:0.0:1790945458.460024:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790945458.460033:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273611392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945458.460069:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945458.460112:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273611392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945458.460118:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1790945458.460158:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881012680 x1877942273611392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945458.460175:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273611392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945458.460836:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273611520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945458.460877:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945458.461841:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273611520 00000100:00100000:3.0:1790945458.461852:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273611520 00000100:00100000:3.0:1790945458.461893:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790945458.461902:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273611520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945458.461934:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790945458.466122:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273611520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4212us (5235us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945458.466138:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1790945458.467971:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881012680 x1877942273611520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945458.468000:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273611520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790945458.907834:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945459.932007:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945460.956167:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945461.413106:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945461.413151:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254706048 00000100:00100000:1.0:1790945461.413152:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945461.413162:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254706048 00000100:00100000:1.0:1790945461.413186:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945461.413208:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 197 00000100:00100000:1.0:1790945461.413211:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945461.413224:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+10:2373:x1877942254706048:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945461.413231:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254706304 00000100:00100000:1.0:1790945461.413234:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254706304 00000100:00100000:1.0:1790945461.413267:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254706432 00000100:00100000:1.0:1790945461.413270:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254706432 00000100:00100000:1.0:1790945461.413288:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:0.0:1790945461.413293:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+10:2373:x1877942254706048:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945461.413294:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2369:x1877942254706304:12345-192.168.202.48@tcp:9:kworker.0 00000100:00100000:0.0:1790945461.413300:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 197 00000020:00000080:1.0:1790945461.413318:0:6670:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f1af 00000100:00080000:1.0:1790945461.413328:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9bb86ca1b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790945461.413366:0:6670:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790945461.413369:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254706176 00000100:00100000:3.0:1790945461.413373:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254706176 00000100:00100000:3.0:1790945461.413404:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 41 00000100:00100000:3.0:1790945461.413410:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254706176:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945461.413440:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254706176:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945461.413452:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 41 00000100:00100000:3.0:1790945461.413474:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:3.0:1790945461.413480:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2369:x1877942254706432:12345-192.168.202.48@tcp:9:kworker.0 00000020:00000080:3.0:1790945461.413498:0:7919:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f1b6 00000100:00080000:3.0:1790945461.413504:0:7919:0:(import.c:65:import_set_state_nolock()) ffff9bb880e94800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790945461.413525:0:7919:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790945461.413709:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+2:2369:x1877942254706304:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 413us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945461.413716:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00080000:1.0:1790945461.413740:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790945461.413744:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945461.413745:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945461.413767:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+2:2369:x1877942254706432:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 286us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945461.413774:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11 00010000:00010000:3.0:1790945461.413821:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945461.414376:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790945461.695419:0:9230:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.2 00010000:00010000:3.0:1790945461.979783:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945463.003934:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945463.068223:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273611648:0@lo:400:kworker.0 00000100:00100000:1.0:1790945463.068224:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945463.068244:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273611776:0@lo:400:kworker.0 00000100:00100000:0.0:1790945463.068384:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273612032:0@lo:400:kworker.0 00000100:00100000:3.0:1790945463.068415:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945463.068429:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273611904:0@lo:400:kworker.0 00000100:00100000:2.0:1790945463.068761:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945463.068838:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273611648 00000100:00100000:2.0:1790945463.068847:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273611648 00000100:00100000:2.0:1790945463.068891:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1790945463.068900:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273611648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945463.068983:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273611648:12345-0@lo:400:kworker.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945463.068990:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1790945463.069037:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273611648:0@lo:400:kworker.0 00000100:00100000:2.0:1790945463.069097:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273612160:0@lo:400:kworker.0 00000100:00100000:2.0:1790945463.069123:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945463.069175:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273612160 00000100:00100000:2.0:1790945463.069189:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273612160 00000100:00100000:2.0:1790945463.069239:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790945463.069246:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273612160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945463.069285:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273612160:12345-0@lo:400:kworker.0 Request processed in 39us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945463.069291:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790945463.069318:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273612160:0@lo:400:kworker.0 00000100:00080000:2.0:1790945463.070242:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945463.074164:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945463.074256:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945463.074280:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273612288:0@lo:400:kworker.0 00000100:00100000:1.0:1790945463.074344:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945463.074397:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273612288 00000100:00100000:1.0:1790945463.074406:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273612288 00000100:00100000:1.0:1790945463.074467:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790945463.074476:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273612288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945463.074538:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273612288:12345-0@lo:400:kworker.0 Request processed in 63us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945463.074545:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1790945463.074585:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790945463.074611:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87acfed80 x1877942273612288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945463.074625:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273612288:0@lo:400:kworker.0 00000100:00100000:2.0:1790945463.074880:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273611776 00000100:00100000:2.0:1790945463.074886:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273611776 00000100:00100000:2.0:1790945463.074929:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790945463.074937:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273611776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945463.074982:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273611776:12345-0@lo:400:kworker.0 Request processed in 46us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945463.074988:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790945463.075630:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273611776:0@lo:400:kworker.0 00000100:00100000:0.0:1790945463.076605:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945463.076755:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273612032 00000100:00100000:1.0:1790945463.076910:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273612032 00000100:00100000:1.0:1790945463.076989:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790945463.077000:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273612032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945463.077074:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273612032:12345-0@lo:400:kworker.0 Request processed in 76us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945463.077083:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1790945463.077105:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881012a00 x1877942273612032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945463.077118:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273612032:0@lo:400:kworker.0 00000100:00080000:2.0:1790945463.077525:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945463.086496:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945463.088269:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273611904 00000100:00100000:2.0:1790945463.088284:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273611904 00000100:00100000:2.0:1790945463.088393:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790945463.088405:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273611904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945463.088503:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273611904:12345-0@lo:400:kworker.0 Request processed in 101us (2014us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945463.088512:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1790945463.089282:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945463.089697:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273611904:0@lo:400:kworker.0 00000100:00100000:3.0:1790945463.580008:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945463.580031:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273612416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945463.580138:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945463.580465:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273612416 00000100:00100000:0.0:1790945463.580475:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273612416 00000100:00100000:0.0:1790945463.580621:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790945463.580632:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273612416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790945463.580698:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945463.580763:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273612416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945463.580771:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790945463.582831:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273612544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945463.582898:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790945463.582988:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881013100 x1877942273612416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945463.583012:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273612416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945463.586757:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273612544 00000100:00100000:3.0:1790945463.586772:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273612544 00000100:00100000:1.0:1790945463.587054:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790945463.587065:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273612544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790945463.587121:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945463.587211:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273612544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (4312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945463.587219:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1790945463.587566:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87acffb80 x1877942273612544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945463.587611:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273612544:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1790945463.904553:0:9327:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.2 00010000:00010000:3.0:1790945464.027773:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945465.053179:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790945465.226556:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000020:00000080:0.0:1790945465.226564:0:6695:0:(genops.c:885:class_export_put()) final put ffff9bb86ca1d000/c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000020:00000080:2.0:1790945465.226965:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb86ca1d000/c6be5708-366a-4e39-b76f-5dba2d1f1a3b for lustre-OST0000 00000020:00000080:2.0:1790945465.227019:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb86ca1b800 for lustre-OST0000 00000001:00100000:3.0:1790945465.670474:0:7627:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000020:00000080:3.0:1790945465.670482:0:7627:0:(genops.c:885:class_export_put()) final put ffff9bb8654d3800/c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000020:00000080:0.0:1790945465.670847:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb8654d3800/c6be5708-366a-4e39-b76f-5dba2d1f1a3b for lustre-OST0001 00000020:00000080:0.0:1790945465.671117:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb880e94800 for lustre-OST0001 00010000:00010000:3.0:1790945466.076840:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945466.516606:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945466.516650:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945466.516699:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254706688 00000100:00100000:3.0:1790945466.516730:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254706688 00000100:00100000:3.0:1790945466.516790:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 45 00000100:00100000:3.0:1790945466.516799:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254706688:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945466.516870:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254706688:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 72us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945466.516877:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 45 00000100:00080000:3.0:1790945466.516910:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945466.517230:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254706560 00000100:00100000:1.0:1790945466.517236:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254706560 00000100:00100000:1.0:1790945466.517269:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 199 00000100:00100000:1.0:1790945466.517276:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:2373:x1877942254706560:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945466.517311:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:2373:x1877942254706560:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 35us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945466.517329:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 199 00000001:02000400:1.0:1790945466.786420:0:9429:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.2 00010000:00010000:2.0:1790945467.106055:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945468.129341:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945468.207702:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273613056:0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.207770:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945468.207824:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790945468.207830:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273612672:0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.207856:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945468.207888:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273613184:0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.207930:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945468.207958:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273612800:0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.207979:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945468.207993:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273613312:0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.208019:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945468.208039:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945468.208044:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273612928:0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.208062:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945468.208088:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273613056 00000100:00100000:1.0:1790945468.208095:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273613056 00000100:00100000:1.0:1790945468.208152:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273613312 00000100:00100000:1.0:1790945468.208155:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273613312 00000100:00100000:1.0:1790945468.208171:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790945468.208178:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273613056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.208227:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273613056:12345-0@lo:400:kworker.0 Request processed in 48us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945468.208233:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790945468.208247:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790945468.208252:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273613312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.208276:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273613312:12345-0@lo:400:kworker.0 Request processed in 24us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945468.208282:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790945468.208295:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273612672 00000100:00100000:1.0:1790945468.208298:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273612672 00000100:00100000:1.0:1790945468.208317:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1790945468.208323:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273612672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.208346:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273612672:12345-0@lo:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945468.208351:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1790945468.208374:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273613184 00000100:00100000:1.0:1790945468.208377:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273613184 00000100:00100000:1.0:1790945468.208405:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273612800 00000100:00100000:1.0:1790945468.208407:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273612800 00000100:00100000:1.0:1790945468.208415:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273612928 00000100:00100000:1.0:1790945468.208417:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273612928 00000100:00100000:1.0:1790945468.208428:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790945468.208433:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273613184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.208459:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273613184:12345-0@lo:400:kworker.0 Request processed in 26us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945468.208465:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790945468.208474:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790945468.208479:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273612800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.208500:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273612800:12345-0@lo:400:kworker.0 Request processed in 21us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945468.208505:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790945468.208513:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790945468.208518:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273612928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.208541:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273612928:12345-0@lo:400:kworker.0 Request processed in 23us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945468.208547:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1790945468.208570:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790945468.208574:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945468.208576:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945468.208601:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273612672:0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.208612:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273613184:0@lo:400:kworker.0 00010000:00080000:1.0:1790945468.208623:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f8d880 x1877942273613056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945468.208644:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273613056:0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.208713:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273612928:0@lo:400:kworker.0 00000100:00100000:1.0:1790945468.208722:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273612800:0@lo:400:kworker.0 00010000:00080000:1.0:1790945468.208730:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb872fec380 x1877942273613312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945468.208738:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273613312:0@lo:400:kworker.0 00000001:02000400:2.0:1790945468.385493:0:9477:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Oct 2 08:51:07 EDT 2026 00000100:00100000:2.0:1790945468.700065:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945468.700088:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273613440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945468.701035:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273613568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945468.701102:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945468.706348:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945468.711702:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273613568 00000100:00100000:1.0:1790945468.711779:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273613440 00000100:00100000:1.0:1790945468.711785:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273613440 00000100:00100000:1.0:1790945468.711844:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790945468.711855:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273613440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790945468.711957:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945468.712088:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273613568 00000100:00100000:1.0:1790945468.716225:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273613440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4361us (9873us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945468.716241:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790945468.716514:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790945468.716532:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273613568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790945468.716572:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945468.716675:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273613568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (15573us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945468.716693:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1790945468.716982:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881012a00 x1877942273613568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945468.717002:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273613568:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1790945468.722062:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87acffb80 x1877942273613440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945468.722091:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273613440:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790945469.148090:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945470.177823:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945471.195858:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945471.636179:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945471.636229:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945471.636563:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254706944 00000100:00100000:1.0:1790945471.636574:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254706944 00000100:00100000:1.0:1790945471.636752:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 49 00000100:00100000:1.0:1790945471.636763:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254706944:12345-192.168.202.48@tcp:400:kworker.0 00000100:00080000:3.0:1790945471.637120:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945471.637216:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254706944:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 453us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945471.637225:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 49 00000100:00100000:1.0:1790945471.637262:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254706816 00000100:00100000:1.0:1790945471.637266:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254706816 00000100:00100000:1.0:1790945471.637290:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 201 00000100:00100000:1.0:1790945471.637296:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:2371:x1877942254706816:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945471.637324:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:2371:x1877942254706816:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 28us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945471.637330:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 201 00010000:00010000:2.0:1790945472.219945:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945473.247243:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945473.311083:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945473.311157:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790945473.311177:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273614080:0@lo:400:kworker.0 00000100:00100000:3.0:1790945473.311242:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945473.311296:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273613952:0@lo:400:kworker.0 00000100:00100000:3.0:1790945473.311319:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945473.311336:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945473.311341:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273613824:0@lo:400:kworker.0 00000100:00100000:3.0:1790945473.311361:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945473.311388:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273614080 00000100:00100000:3.0:1790945473.311394:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273614080 00000100:00100000:3.0:1790945473.311447:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945473.311456:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273614080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945473.311504:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273614080:12345-0@lo:400:kworker.0 Request processed in 49us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945473.311521:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945473.311544:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273613952 00000100:00100000:3.0:1790945473.311548:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273613952 00000100:00100000:3.0:1790945473.311570:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273613824 00000100:00100000:3.0:1790945473.311572:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273613824 00000100:00100000:3.0:1790945473.311588:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790945473.311594:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273613952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945473.311627:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273613952:12345-0@lo:400:kworker.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945473.311632:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790945473.311678:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790945473.311684:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273613824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945473.311711:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273613824:12345-0@lo:400:kworker.0 Request processed in 28us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945473.311717:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1790945473.311736:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945473.311740:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945473.311776:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273613824:0@lo:400:kworker.0 00000100:00100000:3.0:1790945473.311786:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273613952:0@lo:400:kworker.0 00010000:00080000:3.0:1790945473.311814:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87b5c1500 x1877942273614080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945473.311835:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273614080:0@lo:400:kworker.0 00000100:00100000:1.0:1790945473.317536:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273613696:0@lo:400:kworker.0 00000100:00100000:1.0:1790945473.317611:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945473.317679:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273613696 00000100:00100000:1.0:1790945473.317688:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273613696 00000100:00100000:1.0:1790945473.317730:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1790945473.317739:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273613696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945473.317788:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273613696:12345-0@lo:400:kworker.0 Request processed in 50us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945473.317795:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1790945473.317864:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273613696:0@lo:400:kworker.0 00000100:00100000:2.0:1790945473.321797:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273614336:0@lo:400:kworker.0 00000100:00100000:2.0:1790945473.322001:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945473.322048:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945473.322057:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273614208:0@lo:400:kworker.0 00000100:00100000:2.0:1790945473.322087:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945473.322118:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273614336 00000100:00100000:2.0:1790945473.322126:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273614336 00000100:00100000:2.0:1790945473.322182:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790945473.322201:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273614336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945473.322255:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273614336:12345-0@lo:400:kworker.0 Request processed in 56us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945473.322262:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1790945473.322304:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87b5c0380 x1877942273614336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945473.322319:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273614336:0@lo:400:kworker.0 00000100:00080000:2.0:1790945473.322337:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790945473.322353:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273614208 00000100:00100000:2.0:1790945473.322357:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273614208 00000100:00100000:2.0:1790945473.322390:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790945473.322397:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273614208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945473.322433:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273614208:12345-0@lo:400:kworker.0 Request processed in 37us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945473.322440:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790945473.322465:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273614208:0@lo:400:kworker.0 00000100:00080000:2.0:1790945473.322482:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945473.822720:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273614464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945473.822801:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945473.822901:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273614464 00000100:00100000:3.0:1790945473.822909:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273614464 00000100:00100000:3.0:1790945473.822953:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790945473.822962:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273614464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945473.822999:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790945473.823043:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273614464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945473.823050:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1790945473.823091:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb873871180 x1877942273614464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945473.823109:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273614464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945473.826155:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790945473.826178:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273614592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945473.826257:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945473.826312:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273614592 00000100:00100000:3.0:1790945473.826319:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273614592 00000100:00100000:3.0:1790945473.826362:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790945473.826372:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273614592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945473.826408:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790945473.826455:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273614592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945473.826463:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1790945473.826505:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb873871180 x1877942273614592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945473.826523:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273614592:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790945474.268822:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945475.308532:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945476.315800:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945476.756773:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945476.757207:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254707072 00000100:00100000:2.0:1790945476.757224:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254707072 00000100:00100000:2.0:1790945476.757293:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 203 00000100:00100000:2.0:1790945476.757305:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+10:2373:x1877942254707072:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945476.757402:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+10:2373:x1877942254707072:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 99us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945476.757427:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 203 00000100:00100000:3.0:1790945476.761625:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945476.761762:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254707200 00000100:00100000:1.0:1790945476.761776:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254707200 00000100:00100000:1.0:1790945476.761866:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 53 00000100:00100000:1.0:1790945476.761877:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254707200:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945476.761979:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254707200:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 103us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945476.761987:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 53 00000100:00080000:2.0:1790945476.762969:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790945477.341257:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945478.367332:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945478.430605:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273614720:0@lo:400:kworker.0 00000100:00100000:1.0:1790945478.430874:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945478.431456:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273615104:0@lo:400:kworker.0 00000100:00100000:1.0:1790945478.431545:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273615232:0@lo:400:kworker.0 00000100:00100000:1.0:1790945478.431584:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945478.431649:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273614720 00000100:00100000:1.0:1790945478.431675:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273614720 00000100:00100000:1.0:1790945478.432260:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1790945478.432273:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273614720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945478.432351:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273614720:12345-0@lo:400:kworker.0 Request processed in 82us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945478.432360:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1790945478.432401:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273615232 00000100:00100000:1.0:1790945478.432405:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273615232 00000100:00100000:1.0:1790945478.432441:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790945478.432448:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273615232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945478.432609:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945478.432651:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273614848:0@lo:400:kworker.0 00000100:00100000:3.0:1790945478.432702:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790945478.433735:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945478.434105:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273615360:0@lo:400:kworker.0 00000100:00100000:3.0:1790945478.434192:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945478.434245:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945478.434253:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273614976:0@lo:400:kworker.0 00000100:00100000:3.0:1790945478.434281:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945478.436692:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273615232:12345-0@lo:400:kworker.0 Request processed in 4235us (5097us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945478.436710:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790945478.446482:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273615104 00000100:00100000:3.0:1790945478.446498:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273615104 00000100:00100000:3.0:1790945478.446558:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273615360 00000100:00100000:3.0:1790945478.446563:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273615360 00000100:00100000:3.0:1790945478.446600:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790945478.446612:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273615104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945478.446723:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273615104:12345-0@lo:400:kworker.0 Request processed in 114us (14113us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945478.446730:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790945478.446749:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790945478.446755:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273615360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945478.447081:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273615360:12345-0@lo:400:kworker.0 Request processed in 325us (12887us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945478.447088:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790945478.447114:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273614848 00000100:00100000:3.0:1790945478.447118:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273614848 00000100:00100000:3.0:1790945478.447138:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273614976 00000100:00100000:3.0:1790945478.447141:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273614976 00000100:00100000:3.0:1790945478.447174:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790945478.447179:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273614848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945478.447214:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273614848:12345-0@lo:400:kworker.0 Request processed in 35us (14512us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945478.447220:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790945478.447232:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790945478.447238:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273614976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945478.447265:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273614976:12345-0@lo:400:kworker.0 Request processed in 28us (12983us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945478.447270:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1790945478.447393:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881931c00 x1877942273615104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945478.447408:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273615104:0@lo:400:kworker.0 00000100:00100000:3.0:1790945478.447444:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273614976:0@lo:400:kworker.0 00000100:00100000:3.0:1790945478.447455:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273614848:0@lo:400:kworker.0 00010000:00080000:3.0:1790945478.447465:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881932300 x1877942273615360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945478.447473:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273615360:0@lo:400:kworker.0 00000100:00100000:1.0:1790945478.449631:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273614720:0@lo:400:kworker.0 00000100:00100000:1.0:1790945478.449675:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273615232:0@lo:400:kworker.0 00000100:00080000:1.0:1790945478.451469:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790945478.451481:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945478.451483:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945478.939883:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945478.939904:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273615488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945478.940146:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945478.940157:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881010700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273615616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945478.949223:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945478.949808:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273615616 00000100:00100000:0.0:1790945478.949829:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273615616 00000100:00100000:0.0:1790945478.949885:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790945478.949894:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273615616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790945478.949932:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945478.950154:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273615616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 260us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945478.950163:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1790945478.950206:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881010700 x1877942273615616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945478.950226:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881010700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273615616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945478.950795:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945478.951050:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273615488 00000100:00100000:3.0:1790945478.951056:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273615488 00000100:00100000:3.0:1790945478.951084:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790945478.951100:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273615488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945478.951128:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790945478.951175:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273615488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945478.951181:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1790945478.951251:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb873870a80 x1877942273615488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945478.951267:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273615488:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790945479.394005:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945480.412205:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945481.436233:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945481.876024:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945481.876071:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945481.876102:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254707456 00000100:00100000:1.0:1790945481.876122:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254707456 00000100:00100000:1.0:1790945481.876175:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 57 00000100:00100000:1.0:1790945481.876183:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2370:x1877942254707456:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945481.876248:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2370:x1877942254707456:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 66us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945481.876255:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 57 00000100:00080000:1.0:1790945481.876275:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945481.877170:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254707328 00000100:00100000:2.0:1790945481.877178:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254707328 00000100:00100000:2.0:1790945481.877217:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 205 00000100:00100000:2.0:1790945481.877224:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+10:2370:x1877942254707328:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945481.877264:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+10:2370:x1877942254707328:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 40us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945481.877271:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 205 00010000:00010000:2.0:1790945482.459992:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945483.490913:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945483.548096:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273615872:0@lo:400:kworker.0 00000100:00100000:0.0:1790945483.548152:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273615744:0@lo:400:kworker.0 00000100:00100000:3.0:1790945483.548159:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945483.548201:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945483.548207:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273616384:0@lo:400:kworker.0 00000100:00100000:3.0:1790945483.548231:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945483.548236:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273616256:0@lo:400:kworker.0 00000100:00100000:3.0:1790945483.548254:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945483.548260:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273616000:0@lo:400:kworker.0 00000100:00100000:0.0:1790945483.548267:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945483.548292:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945483.548300:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273616128:0@lo:400:kworker.0 00000100:00100000:3.0:1790945483.548309:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945483.548331:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945483.548357:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273616384 00000100:00100000:3.0:1790945483.548365:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273616384 00000100:00100000:0.0:1790945483.548369:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273615872 00000100:00100000:0.0:1790945483.548375:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273615872 00000100:00100000:0.0:1790945483.548415:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273616256 00000100:00100000:0.0:1790945483.548418:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273616256 00000100:00100000:3.0:1790945483.548424:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273616128 00000100:00100000:3.0:1790945483.548428:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273616128 00000100:00100000:0.0:1790945483.548439:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273616000 00000100:00100000:0.0:1790945483.548443:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273616000 00000100:00100000:3.0:1790945483.548451:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790945483.548461:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273616384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945483.548467:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790945483.548476:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273615872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945483.548507:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273616384:12345-0@lo:400:kworker.0 Request processed in 49us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945483.548513:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790945483.548521:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273615872:12345-0@lo:400:kworker.0 Request processed in 45us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945483.548527:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790945483.548532:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790945483.548536:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273616128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945483.548561:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790945483.548570:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273616256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945483.548583:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273616128:12345-0@lo:400:kworker.0 Request processed in 46us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945483.548595:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790945483.548605:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273616256:12345-0@lo:400:kworker.0 Request processed in 36us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945483.548613:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790945483.548628:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790945483.548634:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273616000:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790945483.548641:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790945483.548648:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945483.548651:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790945483.548689:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273616000:12345-0@lo:400:kworker.0 Request processed in 54us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945483.548704:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1790945483.548709:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb873870a80 x1877942273616128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945483.548812:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273616128:0@lo:400:kworker.0 00000100:00100000:3.0:1790945483.548827:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273616256:0@lo:400:kworker.0 00000100:00100000:3.0:1790945483.548856:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273616000:0@lo:400:kworker.0 00000100:00100000:3.0:1790945483.548865:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273615872:0@lo:400:kworker.0 00010000:00080000:3.0:1790945483.548873:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87b5c0380 x1877942273616384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945483.548881:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273616384:0@lo:400:kworker.0 00000100:00100000:2.0:1790945483.548957:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273615744 00000100:00100000:2.0:1790945483.548962:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273615744 00000100:00100000:2.0:1790945483.549044:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1790945483.549053:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273615744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945483.549102:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273615744:12345-0@lo:400:kworker.0 Request processed in 50us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945483.549108:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1790945483.549168:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273615744:0@lo:400:kworker.0 00000100:00100000:3.0:1790945484.061260:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945484.061284:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881013800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273616512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945484.061359:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945484.061435:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273616512 00000100:00100000:3.0:1790945484.061444:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273616512 00000100:00100000:3.0:1790945484.061492:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790945484.061501:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273616512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945484.061535:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945484.061636:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273616640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945484.061709:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945484.062930:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273616512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1428us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945484.062946:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790945484.062979:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273616640 00000100:00100000:3.0:1790945484.062985:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273616640 00000100:00100000:3.0:1790945484.063011:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790945484.063018:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273616640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945484.063047:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790945484.063084:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273616640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945484.063089:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1790945484.063642:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881013800 x1877942273616512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945484.063687:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881013800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273616512:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1790945484.064022:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87f9b1500 x1877942273616640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945484.064032:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273616640:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1790945484.478370:0:10107:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:51:23 (1790945483) === 00010000:00010000:2.0:1790945484.509289:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945485.247731:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945485.247876:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254707584 00000100:00100000:2.0:1790945485.247887:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254707584 00000100:00100000:2.0:1790945485.247943:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 207 00000100:00100000:2.0:1790945485.247966:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:8128:x1877942254707584:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790945485.247983:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945485.248014:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8434afc00/0xc5cf2c2a6a54f27a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8081 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945485.248043:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8434afc00/0xc5cf2c2a6a54f27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8081 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945485.248054:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8434afc00/0xc5cf2c2a6a54f27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8081 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945485.248064:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434afc00, rc 0) 00000100:00100000:2.0:1790945485.248128:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+11:8128:x1877942254707584:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 163us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945485.248136:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 207 00000100:00100000:1.0:1790945485.254967:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945485.255425:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254707712 00000100:00100000:2.0:1790945485.255435:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254707712 00000100:00100000:2.0:1790945485.255538:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 208 00000100:00100000:2.0:1790945485.255548:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+11:8128:x1877942254707712:12345-192.168.202.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790945485.255873:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+11:8128:x1877942254707712:12345-192.168.202.48@tcp:501:mount.lustre.0 Request processed in 325us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945485.255880:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 208 00000100:00100000:3.0:1790945485.258844:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945485.268793:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254707840 00000100:00100000:1.0:1790945485.268810:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254707840 00000100:00100000:1.0:1790945485.268879:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 209 00000100:00100000:1.0:1790945485.268888:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+11:8128:x1877942254707840:12345-192.168.202.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790945485.269127:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+11:8128:x1877942254707840:12345-192.168.202.48@tcp:503:mount.lustre.0 Request processed in 239us (10291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945485.269135:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 209 00000100:00100000:3.0:1790945485.281109:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945485.281317:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254707968 00000100:00100000:1.0:1790945485.281326:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254707968 00000100:00100000:1.0:1790945485.281385:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 210 00000100:00100000:1.0:1790945485.281395:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+11:8132:x1877942254707968:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790945485.281761:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+11:8132:x1877942254707968:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 367us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945485.281769:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 210 00000100:00100000:3.0:1790945485.300861:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945485.303975:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254708096 00000100:00100000:0.0:1790945485.303991:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254708096 00000100:00100000:0.0:1790945485.304064:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 211 00000100:00100000:0.0:1790945485.304074:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+11:8132:x1877942254708096:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790945485.305690:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+11:8132:x1877942254708096:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 1610us (5026us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945485.305702:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 211 00000100:00100000:3.0:1790945485.324239:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945485.324548:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254708224 00000100:00100000:1.0:1790945485.324559:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254708224 00000100:00100000:1.0:1790945485.324698:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 212 00000100:00100000:1.0:1790945485.324721:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+11:8128:x1877942254708224:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790945485.324738:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945485.324756:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb84167b600/0xc5cf2c2a6a54f281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c80ab expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945485.324796:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb84167b600/0xc5cf2c2a6a54f281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80ab expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945485.324808:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb84167b600/0xc5cf2c2a6a54f281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80ab expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945485.324826:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167b600, rc 0) 00000100:00100000:1.0:1790945485.324898:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+12:8128:x1877942254708224:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 191us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945485.325019:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 212 00000100:00100000:3.0:1790945485.329839:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945485.330157:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254708352 00000100:00100000:0.0:1790945485.330167:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254708352 00000100:00100000:0.0:1790945485.330224:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 213 00000100:00100000:0.0:1790945485.330234:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+12:8128:x1877942254708352:12345-192.168.202.48@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790945485.330261:0:5817:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790945485.330287:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790945485.330292:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790945485.330295:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790945485.330297:0:5817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1790945485.333597:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+12:8128:x1877942254708352:12345-192.168.202.48@tcp:256:mount.lustre.0 Request processed in 3351us (3765us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945485.333615:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 213 00000100:00100000:3.0:1790945485.338398:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945485.338493:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254708480 00000100:00100000:1.0:1790945485.338504:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254708480 00000100:00100000:1.0:1790945485.338611:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 214 00000100:00100000:1.0:1790945485.338621:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+12:8128:x1877942254708480:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790945485.338638:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945485.338707:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f288 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c80b2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945485.338741:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80b2 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945485.338753:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80b2 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945485.338762:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167ae00, rc 0) 00000100:00100000:1.0:1790945485.338816:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:8128:x1877942254708480:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 197us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945485.338830:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 214 00000100:00100000:3.0:1790945485.343025:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945485.354122:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254708608 00000100:00100000:2.0:1790945485.354138:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254708608 00000100:00100000:2.0:1790945485.354197:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 215 00000100:00100000:2.0:1790945485.354206:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:8128:x1877942254708608:12345-192.168.202.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790945485.355836:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:8128:x1877942254708608:12345-192.168.202.48@tcp:501:mount.lustre.0 Request processed in 1613us (12804us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945485.355861:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 215 00000100:00100000:3.0:1790945485.363841:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945485.364177:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254708736 00000100:00100000:1.0:1790945485.364187:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254708736 00000100:00100000:1.0:1790945485.364237:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 216 00000100:00100000:1.0:1790945485.364245:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:8128:x1877942254708736:12345-192.168.202.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790945485.364466:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:8128:x1877942254708736:12345-192.168.202.48@tcp:503:mount.lustre.0 Request processed in 220us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945485.364474:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 216 00000100:00100000:3.0:1790945485.368112:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945485.369718:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254708864 00000100:00100000:0.0:1790945485.369731:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254708864 00000100:00100000:0.0:1790945485.369804:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 217 00000100:00100000:0.0:1790945485.369813:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:8136:x1877942254708864:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790945485.370080:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:8136:x1877942254708864:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 267us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945485.370089:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 217 00000100:00100000:3.0:1790945485.376837:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945485.376927:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254708992 00000100:00100000:2.0:1790945485.376938:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254708992 00000100:00100000:2.0:1790945485.376995:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 218 00000100:00100000:2.0:1790945485.377005:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:8136:x1877942254708992:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790945485.377249:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:8136:x1877942254708992:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 244us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945485.377257:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 218 00000100:00100000:3.0:1790945485.382704:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945485.382744:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945485.382800:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254709120 00000100:00100000:1.0:1790945485.382810:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254709120 00000100:00100000:1.0:1790945485.382864:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254709504 00000100:00100000:1.0:1790945485.382867:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254709504 00000100:00100000:1.0:1790945485.382922:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:1.0:1790945485.382932:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254709504:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945485.383001:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254709504:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 71us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945485.383027:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:1.0:1790945485.383045:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:1.0:1790945485.383050:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2369:x1877942254709120:12345-192.168.202.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790945485.383072:0:5825:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 532c7531-c10c-43ae-8cad-28d7c162ca26@192.168.202.48@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:1.0:1790945485.383107:0:5825:0:(genops.c:1384:class_connect()) connect: client 532c7531-c10c-43ae-8cad-28d7c162ca26, cookie 0xc5cf2c2a6a54f28f 00000004:00100000:1.0:1790945485.383136:0:5825:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790945485.383393:0:5825:0:(import.c:65:import_set_state_nolock()) ffff9bb865eda800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790945485.383423:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+6:2369:x1877942254709120:12345-192.168.202.48@tcp:38:mount.lustre.0 Request processed in 371us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945485.383431:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00080000:3.0:1790945485.383732:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945485.393880:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945485.393979:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254709248 00000100:00100000:1.0:1790945485.393989:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254709248 00000100:00100000:1.0:1790945485.394066:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:1.0:1790945485.394076:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+6:0:x1877942254709248:12345-192.168.202.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790945485.394121:0:5825:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1790945485.394198:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945485.394219:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+6:0:x1877942254709248:12345-192.168.202.48@tcp:41:mount.lustre.0 Request processed in 144us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945485.394228:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:3.0:1790945485.394878:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945485.394989:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254709376 00000100:00100000:2.0:1790945485.394995:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254709376 00000100:00100000:2.0:1790945485.395034:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:2.0:1790945485.395042:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+6:8128:x1877942254709376:12345-192.168.202.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790945485.395058:0:7211:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790945485.395102:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+6:8128:x1877942254709376:12345-192.168.202.48@tcp:41:mount.lustre.0 Request processed in 61us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945485.395109:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:0.0:1790945485.410170:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945485.410355:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254709632 00000100:00100000:1.0:1790945485.410365:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254709632 00000100:00100000:1.0:1790945485.410421:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:1.0:1790945485.410431:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+6:8128:x1877942254709632:12345-192.168.202.48@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790945485.410516:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+6:8128:x1877942254709632:12345-192.168.202.48@tcp:40:mount.lustre.0 Request processed in 86us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945485.410550:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:1.0:1790945485.421758:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945485.421808:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945485.421948:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254709760 00000100:00100000:3.0:1790945485.421959:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254709760 00000100:00100000:3.0:1790945485.422001:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254709888 00000100:00100000:3.0:1790945485.422003:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254709888 00000100:00100000:3.0:1790945485.422029:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:3.0:1790945485.422037:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2369:x1877942254709760:12345-192.168.202.48@tcp:8:mount.lustre.0 00000100:00100000:2.0:1790945485.422064:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:2.0:1790945485.422072:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2369:x1877942254709888:12345-192.168.202.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790945485.422086:0:6670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 532c7531-c10c-43ae-8cad-28d7c162ca26@192.168.202.48@tcp t0 exp 0000000000000000 cur 231 last 0 00010000:00080000:2.0:1790945485.422094:0:7919:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 532c7531-c10c-43ae-8cad-28d7c162ca26@192.168.202.48@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:3.0:1790945485.422126:0:6670:0:(genops.c:1384:class_connect()) connect: client 532c7531-c10c-43ae-8cad-28d7c162ca26, cookie 0xc5cf2c2a6a54f296 00000020:00000080:2.0:1790945485.422127:0:7919:0:(genops.c:1384:class_connect()) connect: client 532c7531-c10c-43ae-8cad-28d7c162ca26, cookie 0xc5cf2c2a6a54f29d 00002000:00100000:3.0:1790945485.422203:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 532c7531-c10c-43ae-8cad-28d7c162ca26/ffff9bb87390b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790945485.422229:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790945485.422448:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790945485.422479:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9bb87390f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790945485.422559:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+6:2369:x1877942254709760:12345-192.168.202.48@tcp:8:mount.lustre.0 Request processed in 519us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945485.422566:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12 00002000:00100000:2.0:1790945485.428217:0:7919:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 532c7531-c10c-43ae-8cad-28d7c162ca26/ffff9bb865fce800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790945485.428251:0:7919:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790945485.428498:0:7919:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790945485.428553:0:7919:0:(import.c:65:import_set_state_nolock()) ffff9bb865fc9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945485.428867:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+6:2369:x1877942254709888:12345-192.168.202.48@tcp:8:mount.lustre.0 Request processed in 6792us (7055us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945485.428878:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:2.0:1790945485.432080:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945485.434237:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254710016 00000100:00100000:0.0:1790945485.434252:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254710016 00000100:00100000:0.0:1790945485.434309:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:0.0:1790945485.434319:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+6:8128:x1877942254710016:12345-192.168.202.48@tcp:33:mount.lustre.0 00000004:00200000:0.0:1790945485.434393:0:5826:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790945485.435401:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+6:8128:x1877942254710016:12345-192.168.202.48@tcp:33:mount.lustre.0 Request processed in 1080us (3326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945485.435413:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1 00010000:00010000:2.0:1790945485.531958:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790945485.643234:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 532c7531-c10c-43ae-8cad-28d7c162ca26 00000001:00100000:0.0:1790945486.175428:0:5846:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 532c7531-c10c-43ae-8cad-28d7c162ca26 00000001:00100000:0.0:1790945486.213930:0:7627:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 532c7531-c10c-43ae-8cad-28d7c162ca26 00010000:00010000:2.0:1790945486.556158:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945487.581090:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945488.606332:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945488.670793:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273616896:0@lo:400:kworker.0 00000100:00100000:2.0:1790945488.670860:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945488.670907:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273617408:0@lo:400:kworker.0 00000100:00100000:2.0:1790945488.670932:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945488.670976:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945488.670983:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273617024:0@lo:400:kworker.0 00000100:00100000:2.0:1790945488.671004:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945488.671038:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273616896 00000100:00100000:2.0:1790945488.671593:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273616896 00000100:00100000:2.0:1790945488.671650:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273617024 00000100:00100000:2.0:1790945488.671780:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273617024 00000100:00100000:2.0:1790945488.671814:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790945488.671821:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273616896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945488.671869:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273616896:12345-0@lo:400:kworker.0 Request processed in 49us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945488.671874:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790945488.671889:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790945488.671893:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273617024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945488.671909:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273617024:12345-0@lo:400:kworker.0 Request processed in 16us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945488.671924:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790945488.671941:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273617408 00000100:00100000:2.0:1790945488.671944:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273617408 00000100:00100000:2.0:1790945488.671962:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790945488.671966:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273617408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945488.671987:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273617408:12345-0@lo:400:kworker.0 Request processed in 22us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945488.671991:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790945488.672035:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273617024:0@lo:400:kworker.0 00000100:00100000:3.0:1790945488.672220:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273616768:0@lo:400:kworker.0 00000100:00100000:3.0:1790945488.672265:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945488.672296:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273617280:0@lo:400:kworker.0 00000100:00100000:3.0:1790945488.672314:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945488.672583:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790945488.672591:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273617152:0@lo:400:kworker.0 00000100:00100000:3.0:1790945488.672617:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790945488.672646:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945488.672651:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945488.672686:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273617152 00000100:00100000:3.0:1790945488.672690:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273617152 00000100:00100000:3.0:1790945488.672836:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790945488.672842:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273617152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945488.672869:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273617152:12345-0@lo:400:kworker.0 Request processed in 29us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945488.672874:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790945488.672899:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273616768 00000100:00100000:3.0:1790945488.672902:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273616768 00000100:00100000:3.0:1790945488.672918:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790945488.672921:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273616768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945488.672941:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273616768:12345-0@lo:400:kworker.0 Request processed in 20us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945488.672945:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:3.0:1790945488.672968:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945488.672975:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273617280 00000100:00100000:3.0:1790945488.672977:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273617280 00000100:00100000:3.0:1790945488.672992:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790945488.672996:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273617280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945488.673013:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273617280:12345-0@lo:400:kworker.0 Request processed in 17us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945488.673016:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1790945488.673025:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790945488.673038:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881932a00 x1877942273617152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945488.673047:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273617152:0@lo:400:kworker.0 00000100:00100000:3.0:1790945488.673056:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273616768:0@lo:400:kworker.0 00000100:00100000:3.0:1790945488.673064:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273617280:0@lo:400:kworker.0 00000100:00100000:2.0:1790945488.673160:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273616896:0@lo:400:kworker.0 00010000:00080000:2.0:1790945488.673173:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881930700 x1877942273617408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945488.673178:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273617408:0@lo:400:kworker.0 00000100:00100000:3.0:1790945489.181906:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790945489.181928:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273617664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945489.182007:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945489.182079:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273617664 00000100:00100000:3.0:1790945489.182088:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273617664 00000100:00100000:3.0:1790945489.182148:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790945489.182157:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273617664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945489.182191:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790945489.182536:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273617664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 380us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945489.182544:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1790945489.182586:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87f9b0700 x1877942273617664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945489.182602:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273617664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945489.182792:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945489.182804:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273617536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945489.182854:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945489.182972:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273617536 00000100:00100000:0.0:1790945489.182977:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273617536 00000100:00100000:0.0:1790945489.183018:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790945489.183026:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273617536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790945489.183047:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945489.183092:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273617536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945489.183109:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1790945489.183253:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881013b80 x1877942273617536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945489.183267:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273617536:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790945489.628062:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945490.586992:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945490.587040:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945490.587084:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945490.587117:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945490.587171:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945490.588704:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254710528 00000100:00100000:0.0:1790945490.588718:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254710528 00000100:00100000:0.0:1790945490.588796:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254710656 00000100:00100000:0.0:1790945490.588800:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254710656 00000100:00100000:0.0:1790945490.588825:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 35 00000100:00100000:0.0:1790945490.588835:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254710528:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945490.588912:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254710528:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 78us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945490.588920:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 35 00000100:00100000:0.0:1790945490.588938:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00100000:0.0:1790945490.588945:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254710656:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945490.588973:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254710656:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 29us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945490.588980:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00080000:1.0:1790945490.589066:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945490.589070:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945490.589133:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254710272 00000100:00100000:2.0:1790945490.589139:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254710272 00000100:00100000:2.0:1790945490.589185:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254710400 00000100:00100000:2.0:1790945490.589188:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254710400 00000100:00100000:2.0:1790945490.589213:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:2.0:1790945490.589219:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2370:x1877942254710272:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945490.589248:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2370:x1877942254710272:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 30us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945490.589254:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:2.0:1790945490.589266:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:2.0:1790945490.589272:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254710400:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945490.589324:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254710400:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 52us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945490.589330:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00080000:1.0:1790945490.589449:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945490.589648:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254710144 00000100:00100000:3.0:1790945490.589654:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254710144 00000100:00100000:3.0:1790945490.589708:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 220 00000100:00100000:3.0:1790945490.589715:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254710144:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945490.589742:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254710144:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 28us (2658us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945490.589749:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 220 00010000:00010000:0.0:1790945490.651941:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945491.676079:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790945491.741490:0:10305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1790945492.699943:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945493.724875:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945493.794231:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273617792:0@lo:400:kworker.0 00000100:00100000:0.0:1790945493.794354:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945493.794498:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273617792 00000100:00100000:1.0:1790945493.794509:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273617792 00000100:00100000:1.0:1790945493.794569:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1790945493.794581:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273617792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945493.798747:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273618176:0@lo:400:kworker.0 00000100:00100000:2.0:1790945493.798865:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945493.800049:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273618176 00000100:00100000:2.0:1790945493.800064:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273618176 00000100:00100000:2.0:1790945493.800152:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790945493.800166:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273618176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945493.800263:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273618176:12345-0@lo:400:kworker.0 Request processed in 103us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945493.800271:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1790945493.800323:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87f9b3b80 x1877942273618176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945493.800340:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273618176:0@lo:400:kworker.0 00000100:00100000:2.0:1790945493.802069:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273618048:0@lo:400:kworker.0 00000100:00100000:2.0:1790945493.802151:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945493.802199:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945493.802208:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273617920:0@lo:400:kworker.0 00000100:00100000:2.0:1790945493.802232:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945493.802268:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273618048 00000100:00100000:2.0:1790945493.802277:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273618048 00000100:00100000:2.0:1790945493.802337:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273617920 00000100:00100000:2.0:1790945493.802341:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273617920 00000100:00100000:2.0:1790945493.802384:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790945493.802393:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273618048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945493.802467:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273618048:12345-0@lo:400:kworker.0 Request processed in 75us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945493.802475:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790945493.802495:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790945493.802501:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273617920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945493.802530:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273617920:12345-0@lo:400:kworker.0 Request processed in 29us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945493.802535:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790945493.802578:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273617920:0@lo:400:kworker.0 00000100:00100000:2.0:1790945493.802589:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273618048:0@lo:400:kworker.0 00000100:00100000:1.0:1790945493.803516:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273617792:12345-0@lo:400:kworker.0 Request processed in 8932us (9157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945493.803530:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:1.0:1790945493.803567:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790945493.803574:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945493.805066:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273617792:0@lo:400:kworker.0 00000100:00100000:3.0:1790945493.808406:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945493.808438:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273618304:0@lo:400:kworker.0 00000100:00100000:3.0:1790945493.808546:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945493.808609:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273618304 00000100:00100000:3.0:1790945493.808619:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273618304 00000100:00100000:3.0:1790945493.808735:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790945493.808746:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273618304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945493.808812:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273618304:12345-0@lo:400:kworker.0 Request processed in 67us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945493.808836:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1790945493.808864:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945493.808902:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273618304:0@lo:400:kworker.0 00000100:00100000:3.0:1790945493.808977:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945493.808986:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273618432:0@lo:400:kworker.0 00000100:00100000:3.0:1790945493.809018:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945493.809047:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273618432 00000100:00100000:3.0:1790945493.809051:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273618432 00000100:00100000:3.0:1790945493.809081:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790945493.809087:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273618432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945493.809121:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273618432:12345-0@lo:400:kworker.0 Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945493.809128:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1790945493.809142:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790945493.809163:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87f9b1180 x1877942273618432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945493.809174:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273618432:0@lo:400:kworker.0 00000100:00100000:1.0:1790945494.300252:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945494.300284:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273618560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945494.300398:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945494.300499:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273618560 00000100:00100000:1.0:1790945494.300509:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273618560 00000100:00100000:1.0:1790945494.300573:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790945494.300584:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273618560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945494.300634:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945494.300716:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273618560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945494.300724:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1790945494.300779:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88136c380 x1877942273618560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945494.300803:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273618560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945494.304951:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945494.304996:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273618688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945494.305098:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945494.305191:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273618688 00000100:00100000:1.0:1790945494.305201:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273618688 00000100:00100000:1.0:1790945494.305261:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790945494.305271:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273618688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790945494.305345:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945494.305400:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273618688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945494.305409:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1790945494.305477:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881933b80 x1877942273618688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945494.305522:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273618688:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790945494.747991:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945495.708735:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945495.708772:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945495.708797:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945495.708830:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945495.708855:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945495.708882:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254711040 00000100:00100000:0.0:1790945495.708892:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254711040 00000100:00100000:0.0:1790945495.708946:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254710912 00000100:00100000:0.0:1790945495.708949:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254710912 00000100:00100000:0.0:1790945495.708976:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 70 00000100:00100000:0.0:1790945495.708985:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2372:x1877942254711040:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945495.709077:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2372:x1877942254711040:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 93us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945495.709084:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 70 00000100:00100000:0.0:1790945495.709102:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 71 00000100:00100000:0.0:1790945495.709108:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254710912:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945495.709135:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254710912:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945495.709141:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 71 00000100:00100000:0.0:1790945495.709160:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254711296 00000100:00100000:0.0:1790945495.709163:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254711296 00000100:00100000:0.0:1790945495.709187:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254711168 00000100:00100000:0.0:1790945495.709190:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254711168 00000100:00100000:0.0:1790945495.709210:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 39 00000100:00100000:0.0:1790945495.709216:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2372:x1877942254711296:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945495.709244:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2372:x1877942254711296:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945495.709250:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 39 00000100:00100000:0.0:1790945495.709261:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 40 00000100:00100000:0.0:1790945495.709274:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2372:x1877942254711168:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945495.709301:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2372:x1877942254711168:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945495.709306:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 40 00000100:00080000:0.0:1790945495.709330:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945495.709333:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945495.709335:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945495.710134:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254710784 00000100:00100000:3.0:1790945495.710143:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254710784 00000100:00100000:3.0:1790945495.710182:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 222 00000100:00100000:3.0:1790945495.710191:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:2372:x1877942254710784:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945495.710235:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:2372:x1877942254710784:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 45us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945495.710243:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 222 00010000:00010000:2.0:1790945495.773549:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945496.801917:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945497.820556:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945498.843885:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945498.908820:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273618816:0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.908893:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945498.909235:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273619200:0@lo:400:kworker.0 00000100:00100000:3.0:1790945498.909283:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945498.909347:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273619328:0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.909377:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945498.909426:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273618944:0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.909451:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945498.909469:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273619456:0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.909494:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945498.909510:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945498.909516:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273619072:0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.909562:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945498.909593:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273618816 00000100:00100000:2.0:1790945498.909601:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273618816 00000100:00100000:2.0:1790945498.909643:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1790945498.909652:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273618816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.909724:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273618816:12345-0@lo:400:kworker.0 Request processed in 73us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945498.909732:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1790945498.909765:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273619328 00000100:00100000:2.0:1790945498.909770:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273619328 00000100:00100000:2.0:1790945498.909816:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273618944 00000100:00100000:2.0:1790945498.909819:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273618944 00000100:00100000:2.0:1790945498.909830:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273619072 00000100:00100000:2.0:1790945498.909832:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273619072 00000100:00100000:2.0:1790945498.909847:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790945498.909852:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273619328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.909885:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273619328:12345-0@lo:400:kworker.0 Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945498.909891:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790945498.909903:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790945498.909909:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273618944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.909940:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273618944:12345-0@lo:400:kworker.0 Request processed in 30us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945498.909945:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790945498.909957:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790945498.909963:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273619072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.909989:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273619072:12345-0@lo:400:kworker.0 Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945498.910002:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790945498.910024:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273619200 00000100:00100000:2.0:1790945498.910028:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273619200 00000100:00100000:2.0:1790945498.910051:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273619456 00000100:00100000:2.0:1790945498.910054:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273619456 00000100:00100000:2.0:1790945498.910074:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790945498.910079:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273619200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.910112:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273619200:12345-0@lo:400:kworker.0 Request processed in 34us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945498.910118:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790945498.910129:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790945498.910134:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273619456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.910160:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273619456:12345-0@lo:400:kworker.0 Request processed in 26us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945498.910165:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1790945498.910331:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945498.910335:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790945498.910338:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945498.910382:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273619072:0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.910393:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273618944:0@lo:400:kworker.0 00010000:00080000:2.0:1790945498.910419:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881932a00 x1877942273619456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945498.910429:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273619456:0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.910462:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273618816:0@lo:400:kworker.0 00000100:00100000:2.0:1790945498.910473:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273619328:0@lo:400:kworker.0 00010000:00080000:3.0:1790945498.911730:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881933480 x1877942273619200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945498.911746:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273619200:0@lo:400:kworker.0 00000100:00100000:2.0:1790945499.419908:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790945499.419931:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88136df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273619712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945499.420001:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945499.420055:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273619712 00000100:00100000:1.0:1790945499.420063:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273619712 00000100:00100000:2.0:1790945499.420073:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273619584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945499.420096:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945499.420104:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273619584 00000100:00100000:1.0:1790945499.420107:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273619584 00000100:00100000:1.0:1790945499.420122:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790945499.420131:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273619712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945499.420167:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945499.420218:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273619712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945499.420226:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790945499.420241:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790945499.420247:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273619584:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1790945499.420249:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88136df80 x1877942273619712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945499.420265:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88136df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273619712:0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945499.420265:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945499.420292:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273619584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (196us total) trans 0 rc 0/0 00010000:00080000:2.0:1790945499.420295:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881932680 x1877942273619584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945499.420298:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790945499.420306:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273619584:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790945499.869053:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945500.819870:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945500.819915:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945500.819942:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945500.820029:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254711424 00000100:00100000:1.0:1790945500.820039:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254711424 00000100:00100000:1.0:1790945500.820094:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 224 00000100:00100000:1.0:1790945500.820105:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254711424:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945500.820173:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254711424:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 70us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945500.820181:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 224 00000100:00100000:2.0:1790945500.820297:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254711680 00000100:00100000:2.0:1790945500.820302:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254711680 00000100:00100000:2.0:1790945500.820354:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 75 00000100:00100000:2.0:1790945500.820362:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254711680:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945500.820404:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254711680:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 43us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945500.820411:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 75 00000100:00080000:1.0:1790945500.820468:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945500.820765:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254711936 00000100:00100000:3.0:1790945500.820770:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254711936 00000100:00080000:1.0:1790945500.820808:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945500.820812:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 43 00000100:00100000:3.0:1790945500.820830:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254711936:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945500.820862:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254711936:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 44us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945500.820870:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 43 00000100:00100000:3.0:1790945500.825039:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945500.825169:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945500.825301:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254711808 00000100:00100000:1.0:1790945500.825311:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254711808 00000100:00100000:1.0:1790945500.825394:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 44 00000100:00100000:1.0:1790945500.825404:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254711808:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945500.825505:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254711552 00000100:00100000:2.0:1790945500.825510:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254711552 00000100:00100000:2.0:1790945500.825544:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 76 00000100:00100000:2.0:1790945500.825552:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254711552:12345-192.168.202.48@tcp:400:kworker.0 00000100:00080000:3.0:1790945500.825613:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945500.825618:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945500.830750:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254711808:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 5203us (5436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945500.830766:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 44 00000100:00100000:2.0:1790945500.830911:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254711552:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 5358us (5880us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945500.830944:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 76 00010000:00010000:2.0:1790945500.894180:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945501.916785:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945502.940298:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945503.968314:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945504.028862:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945504.028947:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945504.028969:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273619968:0@lo:400:kworker.0 00000100:00100000:0.0:1790945504.029035:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945504.029096:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273619968 00000100:00100000:0.0:1790945504.029104:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273619968 00000100:00100000:0.0:1790945504.029148:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790945504.029156:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273619968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945504.029208:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273619968:12345-0@lo:400:kworker.0 Request processed in 53us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945504.029215:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790945504.029259:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273619968:0@lo:400:kworker.0 00000100:00100000:0.0:1790945504.035690:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273619840:0@lo:400:kworker.0 00000100:00100000:0.0:1790945504.035968:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945504.036083:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273619840 00000100:00100000:1.0:1790945504.036092:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273619840 00000100:00100000:1.0:1790945504.036141:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1790945504.036150:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273619840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945504.036213:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273619840:12345-0@lo:400:kworker.0 Request processed in 64us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945504.036221:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790945504.036399:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273619840:0@lo:400:kworker.0 00000100:00100000:1.0:1790945504.038318:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273620096:0@lo:400:kworker.0 00000100:00100000:1.0:1790945504.038395:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945504.038440:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945504.038445:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273620224:0@lo:400:kworker.0 00000100:00100000:1.0:1790945504.038471:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945504.038523:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273620096 00000100:00100000:1.0:1790945504.038539:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273620096 00000100:00100000:1.0:1790945504.038595:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790945504.038606:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273620096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945504.038681:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273620096:12345-0@lo:400:kworker.0 Request processed in 78us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945504.038711:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790945504.038746:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273620224 00000100:00100000:1.0:1790945504.038751:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273620224 00000100:00100000:1.0:1790945504.038780:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790945504.038786:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273620224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945504.038820:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273620224:12345-0@lo:400:kworker.0 Request processed in 35us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945504.038826:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1790945504.038842:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790945504.038846:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790945504.038876:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87f9b0700 x1877942273620224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945504.038889:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273620224:0@lo:400:kworker.0 00000100:00100000:1.0:1790945504.038902:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273620096:0@lo:400:kworker.0 00000100:00100000:0.0:1790945504.043969:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273620352:0@lo:400:kworker.0 00000100:00100000:0.0:1790945504.044044:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945504.044155:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273620352 00000100:00100000:2.0:1790945504.044164:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273620352 00000100:00100000:2.0:1790945504.044230:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790945504.044240:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273620352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945504.044299:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273620352:12345-0@lo:400:kworker.0 Request processed in 60us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945504.044307:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1790945504.044380:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945504.044416:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273620352:0@lo:400:kworker.0 00000100:00100000:2.0:1790945504.046979:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945504.046999:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273620480:0@lo:400:kworker.0 00000100:00100000:2.0:1790945504.047062:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945504.047145:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273620480 00000100:00100000:3.0:1790945504.047154:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273620480 00000100:00100000:3.0:1790945504.047219:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790945504.047228:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273620480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945504.047282:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273620480:12345-0@lo:400:kworker.0 Request processed in 55us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945504.047290:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1790945504.047330:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87f9b2d80 x1877942273620480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945504.047343:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273620480:0@lo:400:kworker.0 00000100:00080000:2.0:1790945504.047414:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790945504.541914:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273620608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945504.541988:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945504.542063:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273620608 00000100:00100000:2.0:1790945504.542072:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273620608 00000100:00100000:2.0:1790945504.542115:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790945504.542125:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273620608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945504.542157:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945504.542203:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273620608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945504.542210:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1790945504.542250:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881931880 x1877942273620608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945504.542276:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273620608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945504.545480:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790945504.545501:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273620736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945504.545567:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945504.545612:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273620736 00000100:00100000:0.0:1790945504.545619:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273620736 00000100:00100000:0.0:1790945504.545680:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790945504.545689:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273620736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790945504.545722:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945504.545768:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273620736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945504.545775:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1790945504.545820:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881013480 x1877942273620736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945504.545839:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273620736:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790945504.990372:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945505.940409:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945505.940465:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945505.940491:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945505.940514:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945505.940537:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945505.940577:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254712320 00000100:00100000:0.0:1790945505.940599:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254712320 00000100:00100000:0.0:1790945505.940675:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254712192 00000100:00100000:0.0:1790945505.940678:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254712192 00000100:00100000:0.0:1790945505.940704:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 80 00000100:00100000:0.0:1790945505.940714:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2373:x1877942254712320:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945505.940787:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2373:x1877942254712320:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 74us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945505.940794:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 80 00000100:00100000:0.0:1790945505.940813:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:0.0:1790945505.940819:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254712192:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945505.940844:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254712192:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945505.940849:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:0.0:1790945505.940867:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254712448 00000100:00100000:0.0:1790945505.940870:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254712448 00000100:00100000:0.0:1790945505.940895:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254712576 00000100:00100000:0.0:1790945505.940898:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254712576 00000100:00100000:0.0:1790945505.940916:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:0.0:1790945505.940921:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2369:x1877942254712448:12345-192.168.202.48@tcp:9:kworker.0 00000020:00000080:0.0:1790945505.940939:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f296 00000100:00080000:0.0:1790945505.940948:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9bb87390f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790945505.940984:0:6673:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790945505.941276:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+2:2369:x1877942254712448:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 354us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945505.941283:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:0.0:1790945505.941295:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:0.0:1790945505.941301:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2369:x1877942254712576:12345-192.168.202.48@tcp:9:kworker.0 00000020:00000080:0.0:1790945505.941320:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f29d 00000100:00080000:0.0:1790945505.941325:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9bb865fc9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790945505.941359:0:6673:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790945505.941532:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+2:2369:x1877942254712576:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 230us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945505.941538:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00080000:0.0:1790945505.941558:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945505.941562:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945505.941564:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790945505.941649:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945505.941673:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945505.943724:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254712064 00000100:00100000:1.0:1790945505.943738:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254712064 00000100:00100000:1.0:1790945505.943786:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 226 00000100:00100000:1.0:1790945505.943795:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2373:x1877942254712064:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945505.943857:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2373:x1877942254712064:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 62us (3457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945505.943864:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 226 00010000:00010000:2.0:1790945506.012152:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790945506.164365:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 532c7531-c10c-43ae-8cad-28d7c162ca26 00000020:00000080:0.0:1790945506.164374:0:6695:0:(genops.c:885:class_export_put()) final put ffff9bb87390b800/532c7531-c10c-43ae-8cad-28d7c162ca26 00000020:00000080:2.0:1790945506.164417:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87390b800/532c7531-c10c-43ae-8cad-28d7c162ca26 for lustre-OST0000 00000020:00000080:2.0:1790945506.168871:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb87390f000 for lustre-OST0000 00000001:00100000:0.0:1790945506.665212:0:7627:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 532c7531-c10c-43ae-8cad-28d7c162ca26 00000020:00000080:0.0:1790945506.665222:0:7627:0:(genops.c:885:class_export_put()) final put ffff9bb865fce800/532c7531-c10c-43ae-8cad-28d7c162ca26 00000020:00000080:2.0:1790945506.665290:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb865fce800/532c7531-c10c-43ae-8cad-28d7c162ca26 for lustre-OST0001 00000020:00000080:2.0:1790945506.665349:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb865fc9000 for lustre-OST0001 00010000:00010000:0.0:1790945507.035836:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945508.059825:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790945508.217719:0:11009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790945509.085444:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945509.148415:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88136fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273621120:0@lo:400:kworker.0 00000100:00100000:1.0:1790945509.148498:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945509.148564:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945509.148571:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88136d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273621248:0@lo:400:kworker.0 00000100:00100000:1.0:1790945509.148615:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945509.148686:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273621120 00000100:00100000:1.0:1790945509.148694:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273621120 00000100:00100000:1.0:1790945509.148748:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790945509.148757:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273621120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945509.148812:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273621120:12345-0@lo:400:kworker.0 Request processed in 56us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945509.148819:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790945509.148843:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273621248 00000100:00100000:1.0:1790945509.148847:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273621248 00000100:00100000:1.0:1790945509.148876:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790945509.148883:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273621248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945509.148918:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273621248:12345-0@lo:400:kworker.0 Request processed in 35us (301us total) trans 0 rc 0/0 00000100:00080000:2.0:1790945509.148923:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945509.148925:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1790945509.148931:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790945509.148978:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88136d880 x1877942273621248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945509.148991:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88136d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273621248:0@lo:400:kworker.0 00000100:00100000:1.0:1790945509.149001:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88136fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273621120:0@lo:400:kworker.0 00000100:00100000:0.0:1790945509.149090:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273620992:0@lo:400:kworker.0 00000100:00100000:0.0:1790945509.149122:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945509.149150:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273621504:0@lo:400:kworker.0 00000100:00100000:2.0:1790945509.149174:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273620992 00000100:00100000:0.0:1790945509.149175:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945509.149181:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273620992 00000100:00100000:0.0:1790945509.149215:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790945509.149216:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790945509.149225:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88136c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273620864:0@lo:400:kworker.0 00000100:00100000:2.0:1790945509.149227:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273620992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945509.149308:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945509.149334:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273621376:0@lo:400:kworker.0 00000100:00100000:0.0:1790945509.149357:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945509.149388:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273621376 00000100:00100000:0.0:1790945509.149393:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273621376 00000100:00100000:0.0:1790945509.149422:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790945509.149427:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273621376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945509.149684:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273621504 00000100:00100000:1.0:1790945509.149689:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273621504 00000100:00100000:1.0:1790945509.149719:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790945509.149725:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273621504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945509.151770:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273621376:12345-0@lo:400:kworker.0 Request processed in 2334us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945509.151783:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273620992:12345-0@lo:400:kworker.0 Request processed in 2555us (2657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945509.151783:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790945509.151796:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790945509.151828:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273620864 00000100:00100000:0.0:1790945509.151837:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273620864 00000100:00100000:0.0:1790945509.151878:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1790945509.151885:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273620864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945509.151941:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273620864:12345-0@lo:400:kworker.0 Request processed in 57us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945509.151947:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:0.0:1790945509.151976:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945509.151981:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945509.152006:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88136c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273620864:0@lo:400:kworker.0 00000100:00100000:0.0:1790945509.152019:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273621376:0@lo:400:kworker.0 00000100:00100000:0.0:1790945509.152028:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273620992:0@lo:400:kworker.0 00000100:00100000:1.0:1790945509.152263:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273621504:12345-0@lo:400:kworker.0 Request processed in 2536us (3086us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945509.152272:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1790945509.152375:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb872feea00 x1877942273621504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945509.152386:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273621504:0@lo:400:kworker.0 00000100:00100000:2.0:1790945509.660064:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273621632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945509.660160:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945509.660245:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273621632 00000100:00100000:2.0:1790945509.660255:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273621632 00000100:00100000:2.0:1790945509.660335:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790945509.660346:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273621632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945509.660390:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945509.660437:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273621632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945509.660460:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1790945509.660520:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88133ed80 x1877942273621632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945509.660824:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273621632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945509.660843:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945509.660849:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273621760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945509.660875:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945509.661207:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273621760 00000100:00100000:0.0:1790945509.661213:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273621760 00000100:00100000:0.0:1790945509.661239:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790945509.661246:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273621760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945509.661281:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945509.661343:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273621760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945509.661350:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1790945509.662217:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88133ea00 x1877942273621760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945509.662238:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273621760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790945510.114008:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945511.060008:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945511.060076:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945511.060128:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945511.060211:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254712960 00000100:00100000:3.0:1790945511.060222:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254712960 00000100:00100000:3.0:1790945511.060321:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254712832 00000100:00100000:3.0:1790945511.060325:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254712832 00000100:00100000:3.0:1790945511.060347:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00100000:3.0:1790945511.060357:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254712960:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945511.060428:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254712960:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 72us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945511.060435:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00100000:3.0:1790945511.060455:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 86 00000100:00100000:3.0:1790945511.060461:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254712832:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945511.060488:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254712832:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945511.060494:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 86 00000100:00100000:1.0:1790945511.060805:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254712704 00000100:00100000:1.0:1790945511.060810:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254712704 00000100:00100000:1.0:1790945511.060848:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 228 00000100:00100000:1.0:1790945511.060856:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:2371:x1877942254712704:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945511.060894:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:2371:x1877942254712704:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 38us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945511.060901:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 228 00000100:00080000:0.0:1790945511.061153:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790945511.132999:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790945511.879009:0:11156:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8fcbaf70 20000000:00000080:2.0:1790945511.879031:0:11156:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb87fed2c00 uarg=0000000000000000 20000000:01000000:2.0:1790945511.879072:0:11156:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790945511.879078:0:11156:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790945511.879084:0:11156:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790945511.886138:0:11157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1790945511.886415:0:11156:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790945511.895986:0:11156:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790945511.896209:0:11156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.896232:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8821c5600/0xc5cf2c2a6a54f249 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c807a expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.896241:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54f257 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f250 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.896249:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb865d1c400/0xc5cf2c2a6a54f265 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f25e expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.896256:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f273 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f26c expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.896287:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80b2 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.896295:0:11156:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.896348:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80b2 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.896366:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f288 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80b2 expref: 12 pid: 5815 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945511.896381:0:11156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1877942273621888:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945511.896519:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f26c expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.896526:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f273 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f26c expref: 18 pid: 5818 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945511.896536:0:11156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1877942273622016:0@lo:104: 00000100:00100000:3.0:1790945511.896580:0:11156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790945511.896612:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb865d1c400/0xc5cf2c2a6a54f265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f25e expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.896620:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb865d1c400/0xc5cf2c2a6a54f265 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f25e expref: 18 pid: 5815 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945511.896628:0:11156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1877942273622144:0@lo:104: 00000100:00100000:3.0:1790945511.896672:0:11156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790945511.896695:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54f257 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f250 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.896704:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54f257 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f250 expref: 18 pid: 5815 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945511.896711:0:11156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1877942273622272:0@lo:104: 00000100:00100000:1.0:1790945511.896944:0:7614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273622016 00000100:00100000:1.0:1790945511.896953:0:7614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273622016 00000100:00100000:1.0:1790945511.897001:0:7614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273622144 00000100:00100000:1.0:1790945511.897004:0:7614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273622144 00000100:00100000:1.0:1790945511.897023:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790945511.897031:0:7614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:11156:x1877942273622016:12345-0@lo:104: 00010000:00010000:1.0:1790945511.897042:0:7614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897106:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790945511.897112:0:7614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:11156:x1877942273622016:12345-0@lo:104: Request processed in 83us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945511.897120:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790945511.897137:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790945511.897143:0:7614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:11156:x1877942273622144:12345-0@lo:104: 00010000:00010000:1.0:1790945511.897150:0:7614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897183:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790945511.897188:0:7614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:11156:x1877942273622144:12345-0@lo:104: Request processed in 46us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945511.897204:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1790945511.897231:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790945511.897238:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897244:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4800 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1790945511.897249:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897257:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945511.897263:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945511.897269:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790945511.897333:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897339:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945511.897360:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897367:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4800/0xc5cf2c2a6a54f26c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897381:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945511.897384:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897401:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434afe00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1790945511.897404:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897410:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945511.897416:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945511.897421:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790945511.897434:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897440:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945511.897446:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897451:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8434afe00/0xc5cf2c2a6a54f25e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897460:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945511.897462:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945511.897464:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945511.897471:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945511.897489:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872feca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273622400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945511.897523:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945511.897555:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945511.897561:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273622528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945511.897588:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945511.897617:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273622400 00000100:00100000:1.0:1790945511.897621:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273622400 00010000:00010000:1.0:1790945511.897639:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f273 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f26c expref: 19 pid: 5818 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945511.897681:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273622528 00000100:00100000:1.0:1790945511.897684:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273622528 00010000:00010000:1.0:1790945511.897696:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb865d1c400/0xc5cf2c2a6a54f265 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f25e expref: 20 pid: 5815 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945511.897852:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790945511.897862:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+20:3292:x1877942273622400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790945511.897873:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945511.897878:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f273 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f26c expref: 20 pid: 5818 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897886:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f273 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f26c expref: 20 pid: 5818 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.897901:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945511.897930:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+20:3292:x1877942273622400:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945511.897936:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790945511.897992:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790945511.897998:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273622528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790945511.898005:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945511.898009:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb865d1c400/0xc5cf2c2a6a54f265 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f25e expref: 19 pid: 5815 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.898026:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb865d1c400/0xc5cf2c2a6a54f265 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f25e expref: 19 pid: 5815 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.898034:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945511.898054:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273622528:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945511.898060:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790945511.899012:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273622528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945511.899026:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872feca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273622400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945511.899383:0:11156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790945511.899449:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8821c5600/0xc5cf2c2a6a54f249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c807a expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.899698:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb8821c5600/0xc5cf2c2a6a54f249 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c807a expref: 12 pid: 5817 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945511.899712:0:11156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1877942273622656:192.168.202.48@tcp:104: 00000100:00100000:3.0:1790945511.900302:0:11156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8654abf00 going to sleep for 11 seconds 00010000:00010000:3.0:1790945511.900332:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f273 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f26c expref: 18 pid: 5818 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945511.900346:0:11156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1877942273622016:0@lo:104: 00010000:00010000:3.0:1790945511.900356:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865d1c400/0xc5cf2c2a6a54f265 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f25e expref: 17 pid: 5815 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945511.900363:0:11156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1877942273622144:0@lo:104: 00000100:00100000:1.0:1790945511.901202:0:7614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273622272 00000100:00100000:1.0:1790945511.901212:0:7614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273622272 00000100:00100000:1.0:1790945511.901286:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790945511.901298:0:7614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:11156:x1877942273622272:12345-0@lo:104: 00010000:00010000:1.0:1790945511.901326:0:7614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f257 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.901397:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790945511.901404:0:7614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:11156:x1877942273622272:12345-0@lo:104: Request processed in 110us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945511.901411:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1790945511.901431:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945511.901436:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f257 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.901443:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c000 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1790945511.901448:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f257 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.901483:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f257 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790945511.901491:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f257 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945511.901498:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790945511.901530:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f257 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.901537:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790945511.901557:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f257 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.901565:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c000/0xc5cf2c2a6a54f250 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f257 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.901584:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945511.901586:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945511.901588:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945511.901602:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872feca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273622784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945511.901634:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945511.901710:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273622784 00000100:00100000:1.0:1790945511.902026:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273622784 00010000:00010000:1.0:1790945511.902048:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54f257 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f250 expref: 17 pid: 5815 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945511.902146:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790945511.902154:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:3294:x1877942273622784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790945511.902171:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945511.902177:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54f257 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f250 expref: 17 pid: 5815 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.902187:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54f257 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f250 expref: 17 pid: 5815 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.902203:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945511.902235:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:3294:x1877942273622784:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945511.902242:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790945511.902287:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872feca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273622784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945511.905766:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167b400/0xc5cf2c2a6a54f257 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f250 expref: 16 pid: 5815 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945511.905786:0:11156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1877942273622272:0@lo:104: 00000100:00100000:2.0:1790945511.913619:0:11156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1877942273621888:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945511.916200:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945511.918119:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254713088 00000100:00100000:3.0:1790945511.918132:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254713088 00010000:00010000:3.0:1790945511.918178:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f288 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80b2 expref: 13 pid: 5815 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945511.918242:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 28 00000100:00100000:3.0:1790945511.918253:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872feca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee3b157-ad31-4030-99ec-031c727e7689+13:2372:x1877942254713088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945511.918271:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945511.918287:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f288 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80b2 expref: 13 pid: 5815 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.918313:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80b2 expref: 13 pid: 5815 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.918332:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f288 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80b2 expref: 13 pid: 5815 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.918348:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945511.919007:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872feca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee3b157-ad31-4030-99ec-031c727e7689+12:2372:x1877942254713088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 752us (2813us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945511.919018:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 28 00000100:00100000:3.0:1790945511.922530:0:11156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1877942273622656:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945511.922573:0:11156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945511.923481:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945511.923670:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254713216 00000100:00100000:1.0:1790945511.923678:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254713216 00010000:00010000:1.0:1790945511.923726:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8821c5600/0xc5cf2c2a6a54f249 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c807a expref: 12 pid: 5817 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945511.923766:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 29 00000100:00100000:1.0:1790945511.923775:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee3b157-ad31-4030-99ec-031c727e7689+12:2373:x1877942254713216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945511.923789:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945511.923794:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8821c5600/0xc5cf2c2a6a54f249 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c807a expref: 12 pid: 5817 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.923805:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8821c5600/0xc5cf2c2a6a54f249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c807a expref: 12 pid: 5817 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.923823:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c5600/0xc5cf2c2a6a54f249 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c807a expref: 12 pid: 5817 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.923853:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.923861:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.923876:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.923882:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.923889:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.923896:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.923903:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945511.923907:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.923914:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.923926:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945511.923935:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945511.923987:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee3b157-ad31-4030-99ec-031c727e7689+11:2373:x1877942254713216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 212us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945511.924000:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 29 00010000:00010000:3.0:1790945511.925649:0:11156:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.926167:0:11156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945511.926175:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2a4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945512.165317:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945513.179862:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790945513.372095:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790945513.372104:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb87fbcd800 from 7 10000000:01000000:1.0:1790945513.372109:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790945513.372152:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945513.372164:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945513.372175:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945513.372199:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273622912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790945513.372276:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945513.372334:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843f0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1790945513.373648:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273622912 00000100:00100000:2.0:1790945513.373673:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273622912 00000100:00100000:2.0:1790945513.373741:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790945513.373751:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273622912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945513.373768:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945513.373786:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8434ae400/0xc5cf2c2a6a54f2b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f2ab expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945513.373811:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8434ae400/0xc5cf2c2a6a54f2b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f2ab expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945513.373822:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8434ae400/0xc5cf2c2a6a54f2b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f2ab expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945513.373831:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434ae400, rc 0) 00000100:00100000:2.0:1790945513.373889:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273622912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945513.373895:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1790945513.377508:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273622912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945513.377537:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f2b2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945513.377550:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f2b2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945513.377624:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945513.377696:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945513.377740:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843f0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1790945513.378031:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273623040 00000100:00100000:2.0:1790945513.378039:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273623040 00000100:00100000:2.0:1790945513.378087:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1790945513.378099:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273623040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945513.378822:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273623040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 725us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945513.378833:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1790945513.379006:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945513.379046:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945513.379091:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945513.379131:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843f0e540 going to sleep for 11 seconds 00000100:00100000:2.0:1790945513.379192:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273623168 00000100:00100000:2.0:1790945513.379198:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273623168 00000100:00100000:2.0:1790945513.379233:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1790945513.379241:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273623168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945513.379417:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273623168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945513.379430:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790945513.379620:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872feea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790945513.380796:0:11202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790945513.380954:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790945513.380972:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945513.380982:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f2b2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945513.380995:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f2b2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945513.381005:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790945513.381008:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb8654d2800 from 7 10000000:01000000:2.0:1790945513.381011:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790945513.381041:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945513.381049:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945513.381058:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945513.381076:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790945513.381123:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945513.381162:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842f4f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945513.381208:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273623296 00000100:00100000:1.0:1790945513.381214:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273623296 00000100:00100000:1.0:1790945513.381258:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1790945513.381276:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273623296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945513.381288:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945513.381301:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb84167a400/0xc5cf2c2a6a54f2c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f2b9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945513.381322:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb84167a400/0xc5cf2c2a6a54f2c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f2b9 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945513.381332:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb84167a400/0xc5cf2c2a6a54f2c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f2b9 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945513.381340:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167a400, rc 0) 00000100:00100000:1.0:1790945513.381487:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273623296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945513.381580:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945513.381593:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f2c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945513.381602:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f2c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945513.381676:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945513.381703:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945513.381718:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842f4f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945513.381764:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1790945513.381790:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273623424 00000100:00100000:1.0:1790945513.381794:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273623424 00000100:00100000:1.0:1790945513.381848:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1790945513.381858:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273623424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945513.382097:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273623424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945513.382104:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1790945513.387696:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881930700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945513.387768:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945513.387853:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945513.388989:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945513.389626:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273623552 00000100:00100000:1.0:1790945513.389639:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273623552 00000100:00100000:1.0:1790945513.393980:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1790945513.393996:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273623552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945513.394245:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273623552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (6392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945513.394253:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1790945513.394327:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790945513.397167:0:11205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790945513.397356:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790945513.397384:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790945513.397397:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f2c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945513.397408:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f2c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945513.397419:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790945513.397421:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb845514800 from 7 10000000:01000000:0.0:1790945513.397424:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790945513.397469:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945513.397477:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945513.397487:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945513.397595:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790945513.397686:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945513.397726:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8654436c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945513.397847:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273623680 00000100:00100000:3.0:1790945513.397856:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273623680 00000100:00100000:3.0:1790945513.397914:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1790945513.397923:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273623680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945513.397937:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945513.397951:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f2c7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945513.397975:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f2c7 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945513.397986:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f2c7 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945513.397995:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c5000, rc 0) 00000100:00100000:3.0:1790945513.398042:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273623680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945513.398049:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1790945513.398099:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945513.398114:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f2ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945513.398130:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f2ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945513.398182:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945513.398208:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945513.398221:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f540 going to sleep for 11 seconds 00000100:00100000:3.0:1790945513.398232:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273623808 00000100:00100000:3.0:1790945513.398235:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273623808 00000100:00100000:3.0:1790945513.398252:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1790945513.398257:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273623808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945513.399632:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273623808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1369us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945513.399643:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1790945513.399770:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945513.399816:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945513.399860:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945513.399897:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8654433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945513.399939:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273623936 00000100:00100000:3.0:1790945513.399944:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273623936 00000100:00100000:3.0:1790945513.400583:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1790945513.400594:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273623936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945513.400802:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273623936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945513.400809:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1790945513.402887:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273623936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790945513.405886:0:11206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790945513.410475:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790945513.410614:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945513.410628:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f2ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945513.410640:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f2ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945513.624914:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945513.625312:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254713344 00000100:00100000:0.0:1790945513.625324:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254713344 00000100:00100000:0.0:1790945513.625426:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 238 00000100:00100000:0.0:1790945513.625438:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+11:5615:x1877942254713344:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945513.625457:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945513.625474:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f2d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c80dc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945513.625515:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f2d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80dc expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945513.625527:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f2d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80dc expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945513.625537:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1da00, rc 0) 00000100:00100000:0.0:1790945513.625612:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+12:5615:x1877942254713344:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 176us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945513.625628:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 238 00000100:00100000:1.0:1790945513.629922:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945513.631673:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254713472 00000100:00100000:2.0:1790945513.631686:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254713472 00000100:00100000:2.0:1790945513.631735:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 239 00000100:00100000:2.0:1790945513.631745:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+12:5615:x1877942254713472:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945513.632030:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+12:5615:x1877942254713472:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 285us (2116us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945513.632039:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 239 00000100:00100000:1.0:1790945513.639741:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945513.639863:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254713600 00000100:00100000:2.0:1790945513.639875:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254713600 00000100:00100000:2.0:1790945513.639980:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 240 00000100:00100000:2.0:1790945513.639991:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+12:5615:x1877942254713600:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945513.640219:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+12:5615:x1877942254713600:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 229us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945513.640237:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 240 00000100:00100000:2.0:1790945513.655716:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945513.658603:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254713728 00000100:00100000:1.0:1790945513.658619:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254713728 00000100:00100000:1.0:1790945513.658754:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 241 00000100:00100000:1.0:1790945513.658764:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+12:5615:x1877942254713728:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945513.658783:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945513.658802:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f2dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c80e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945513.658834:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f2dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80e3 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945513.658846:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f2dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80e3 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945513.658866:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167ae00, rc 0) 00000100:00100000:1.0:1790945513.658951:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:5615:x1877942254713728:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 187us (3244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945513.658959:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 241 00000100:00100000:2.0:1790945513.663779:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945513.665602:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254713856 00000100:00100000:0.0:1790945513.665618:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254713856 00000100:00100000:0.0:1790945513.665686:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 242 00000100:00100000:0.0:1790945513.665697:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:5615:x1877942254713856:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945513.665992:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:5615:x1877942254713856:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 297us (2222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945513.666001:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 242 00000100:00100000:2.0:1790945513.669708:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945513.669943:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254713984 00000100:00100000:1.0:1790945513.669953:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254713984 00000100:00100000:1.0:1790945513.670000:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 243 00000100:00100000:1.0:1790945513.670009:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:5615:x1877942254713984:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945513.670212:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:5615:x1877942254713984:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 203us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945513.670221:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 243 00010000:00010000:3.0:1790945514.205767:0:759:0:(ldlm_pool.c:1330:ldlm_pools_recalc_task()) Negative interval(0) 00010000:00010000:1.0:1790945514.206219:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945514.267985:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273624064:0@lo:400:kworker.0 00000100:00100000:0.0:1790945514.268066:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945514.268136:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273624064 00000100:00100000:2.0:1790945514.268148:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273624064 00000100:00100000:2.0:1790945514.268199:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1790945514.268207:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273624064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945514.272532:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88136c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273624448:0@lo:400:kworker.0 00000100:00100000:1.0:1790945514.272609:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945514.272652:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945514.272685:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88136fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273624576:0@lo:400:kworker.0 00000100:00100000:1.0:1790945514.272711:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945514.272740:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273624192:0@lo:400:kworker.0 00000100:00100000:1.0:1790945514.272763:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945514.272779:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88136d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273624704:0@lo:400:kworker.0 00000100:00100000:1.0:1790945514.272798:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945514.272814:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945514.272819:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273624320:0@lo:400:kworker.0 00000100:00100000:1.0:1790945514.272837:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945514.272887:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273624448 00000100:00100000:1.0:1790945514.272896:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273624448 00000100:00100000:1.0:1790945514.272947:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273624704 00000100:00100000:1.0:1790945514.272950:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273624704 00000100:00100000:1.0:1790945514.272968:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790945514.272976:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273624448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945514.273026:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273624448:12345-0@lo:400:kworker.0 Request processed in 50us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945514.273033:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790945514.273049:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790945514.273054:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273624704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945514.273082:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273624704:12345-0@lo:400:kworker.0 Request processed in 28us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945514.273088:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790945514.273104:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273624576 00000100:00100000:1.0:1790945514.273107:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273624576 00000100:00100000:1.0:1790945514.273128:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273624192 00000100:00100000:1.0:1790945514.273131:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273624192 00000100:00100000:1.0:1790945514.273139:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273624320 00000100:00100000:1.0:1790945514.273141:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273624320 00000100:00100000:1.0:1790945514.273151:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790945514.273157:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273624576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945514.273185:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273624576:12345-0@lo:400:kworker.0 Request processed in 28us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945514.273191:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790945514.273201:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790945514.273206:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273624192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945514.273228:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273624192:12345-0@lo:400:kworker.0 Request processed in 23us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945514.273241:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790945514.273264:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790945514.273269:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273624320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945514.273296:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273624320:12345-0@lo:400:kworker.0 Request processed in 27us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945514.273301:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790945514.273349:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273624320:0@lo:400:kworker.0 00000100:00100000:1.0:1790945514.273360:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273624192:0@lo:400:kworker.0 00010000:00080000:1.0:1790945514.273370:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88136d880 x1877942273624704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945514.273379:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88136d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273624704:0@lo:400:kworker.0 00000100:00100000:1.0:1790945514.273407:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88136fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273624576:0@lo:400:kworker.0 00010000:00080000:1.0:1790945514.273415:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88136c700 x1877942273624448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945514.273423:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88136c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273624448:0@lo:400:kworker.0 00000100:00080000:1.0:1790945514.273582:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790945514.273587:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945514.273590:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945514.283804:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273624064:12345-0@lo:400:kworker.0 Request processed in 15587us (15727us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945514.283820:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790945514.283954:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273624064:0@lo:400:kworker.0 00000100:00100000:2.0:1790945514.779853:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273624832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945514.779934:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945514.779936:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945514.779951:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273624960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945514.779978:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945514.780009:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273624832 00000100:00100000:2.0:1790945514.780017:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273624832 00000100:00100000:2.0:1790945514.780054:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273624960 00000100:00100000:2.0:1790945514.780057:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273624960 00000100:00100000:2.0:1790945514.780075:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790945514.780083:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273624832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945514.780121:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945514.780175:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273624832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945514.780182:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790945514.780198:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1790945514.780267:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881931c00 x1877942273624832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945514.780286:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273624832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945514.780347:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273624960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790945514.780368:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945514.780419:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273624960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 212us (438us total) trans 0 rc 0/0 00010000:00080000:0.0:1790945514.784181:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb88133c380 x1877942273624960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945514.784210:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273624960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945514.787653:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1790945515.228095:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790945515.618556:0:11354:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1790945516.184647:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945516.184733:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945516.184773:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945516.184859:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254714240 00000100:00100000:3.0:1790945516.184869:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254714240 00000100:00100000:3.0:1790945516.184932:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254714368 00000100:00100000:3.0:1790945516.184948:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254714368 00000100:00100000:3.0:1790945516.184977:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 90 00000100:00100000:3.0:1790945516.184985:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254714240:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945516.185071:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254714240:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 86us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945516.185078:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 90 00000100:00100000:3.0:1790945516.185099:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 91 00000100:00100000:3.0:1790945516.185105:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254714368:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945516.185132:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254714368:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945516.185137:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 91 00000100:00100000:2.0:1790945516.185346:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254714112 00000100:00100000:2.0:1790945516.185350:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254714112 00000100:00100000:2.0:1790945516.185394:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 245 00000100:00100000:2.0:1790945516.185402:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254714112:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945516.185437:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254714112:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 36us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945516.185444:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 245 00000100:00080000:0.0:1790945516.185912:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790945516.251890:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945517.277808:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945518.300210:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945519.327775:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945519.389835:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273625472:0@lo:400:kworker.0 00000100:00100000:2.0:1790945519.389913:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945519.389915:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273625216:0@lo:400:kworker.0 00000100:00100000:2.0:1790945519.389968:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790945519.389976:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273625088:0@lo:400:kworker.0 00000100:00100000:2.0:1790945519.390158:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945519.390192:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273625600:0@lo:400:kworker.0 00000100:00100000:2.0:1790945519.390228:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945519.390241:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273625088 00000100:00100000:0.0:1790945519.390252:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273625088 00000100:00100000:2.0:1790945519.390260:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273625600 00000100:00100000:2.0:1790945519.390265:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273625600 00000100:00100000:0.0:1790945519.390301:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1790945519.390312:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273625088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945519.390314:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790945519.390327:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273625600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945519.390379:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273625088:12345-0@lo:400:kworker.0 Request processed in 70us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945519.390386:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1790945519.391144:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273625600:12345-0@lo:400:kworker.0 Request processed in 817us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945519.391153:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1790945519.391180:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945519.391224:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273625088:0@lo:400:kworker.0 00000100:00100000:2.0:1790945519.391237:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273625600:0@lo:400:kworker.0 00000100:00100000:1.0:1790945519.394748:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945519.394980:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273625216 00000100:00100000:0.0:1790945519.394991:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273625216 00000100:00100000:0.0:1790945519.395046:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790945519.395056:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273625216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945519.395545:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273625728:0@lo:400:kworker.0 00000100:00100000:1.0:1790945519.395647:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945519.395742:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273625472 00000100:00100000:2.0:1790945519.395748:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273625472 00000100:00100000:2.0:1790945519.395786:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273625728 00000100:00100000:2.0:1790945519.395789:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273625728 00000100:00100000:2.0:1790945519.395806:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790945519.395826:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273625472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945519.395872:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273625472:12345-0@lo:400:kworker.0 Request processed in 48us (5959us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945519.395879:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790945519.395895:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790945519.395901:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273625728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945519.395928:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273625728:12345-0@lo:400:kworker.0 Request processed in 27us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945519.395933:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1790945519.395949:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945519.395952:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790945519.395979:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f8dc00 x1877942273625472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945519.395992:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273625472:0@lo:400:kworker.0 00000100:00100000:0.0:1790945519.396281:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273625216:12345-0@lo:400:kworker.0 Request processed in 1224us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945519.396290:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790945519.396727:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273625344:0@lo:400:kworker.0 00000100:00100000:0.0:1790945519.396765:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945519.398256:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273625216:0@lo:400:kworker.0 00010000:00080000:1.0:1790945519.398366:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f8d880 x1877942273625728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945519.398378:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273625728:0@lo:400:kworker.0 00000100:00100000:2.0:1790945519.402733:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273625344 00000100:00100000:2.0:1790945519.402748:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273625344 00000100:00100000:2.0:1790945519.402849:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790945519.402859:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273625344:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790945519.402943:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945519.402972:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273625344:12345-0@lo:400:kworker.0 Request processed in 114us (6205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945519.402980:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790945519.403029:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273625344:0@lo:400:kworker.0 00000001:02000400:2.0:1790945519.726803:0:11455:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:51:58 (1790945518) === 00000100:00100000:2.0:1790945519.886637:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945519.886768:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945519.886823:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254714624 00000100:00100000:2.0:1790945519.886833:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254714624 00000100:00100000:2.0:1790945519.886888:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:2.0:1790945519.886899:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:9680:x1877942254714624:12345-192.168.202.48@tcp:700:mkdir.0 00000100:00100000:2.0:1790945519.886979:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:9680:x1877942254714624:12345-192.168.202.48@tcp:700:mkdir.0 Request processed in 82us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945519.886987:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:0.0:1790945519.887290:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254714496 00000100:00100000:0.0:1790945519.887295:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254714496 00000100:00100000:0.0:1790945519.887336:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:0.0:1790945519.887344:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2370:x1877942254714496:12345-192.168.202.48@tcp:41:mkdir.0 00000004:00000024:0.0:1790945519.887376:0:5825:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790945519.887653:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2370:x1877942254714496:12345-192.168.202.48@tcp:41:mkdir.0 Request processed in 310us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945519.887688:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00080000:0.0:1790945519.887709:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945519.890596:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945519.890883:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254714880 00000100:00100000:3.0:1790945519.890895:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254714880 00000100:00100000:3.0:1790945519.890961:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:3.0:1790945519.890972:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:9680:x1877942254714880:12345-192.168.202.48@tcp:36:mkdir.0 00010000:00010000:3.0:1790945519.891033:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945519.891090:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af800/0xc5cf2c2a6a54f1c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8065 expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.891113:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb845042f00) 00010000:00010000:3.0:1790945519.891134:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945519.891489:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f2e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.891504:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f2e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.891520:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f2e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.891549:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f2ea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.891558:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f2ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.891565:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f2ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945519.892783:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790945519.892799:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f2e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.892809:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f2e3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.892816:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f2e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.892822:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945519.892827:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f2e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.892835:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f2e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.892849:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb851c9a400) 00010000:00010000:3.0:1790945519.892852:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945519.892864:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f2e3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.892870:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f2e3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790945519.892891:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000069387239 reply state 000000003ec90d12 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f2ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945519.892900:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945519.893011:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:9680:x1877942254714880:12345-192.168.202.48@tcp:36:mkdir.0 Request processed in 2036us (2417us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790945519.893022:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 15 00010000:00010000:3.0:1790945519.895348:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f2ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.895365:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f2ea lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.895373:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f2ea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.896481:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945519.896489:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f2ea lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.896501:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f2ea lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.896517:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bb851c9ab00) 00010000:00010000:3.0:1790945519.896520:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945519.896525:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f2ea lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.896538:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f2ea lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945519.900051:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273625856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945519.900127:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945519.900170:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273625984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945519.900218:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945519.903667:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945519.903703:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254715008 00000100:00100000:3.0:1790945519.903711:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254715008 00000100:00100000:3.0:1790945519.903751:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:3.0:1790945519.903758:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:9682:x1877942254715008:12345-192.168.202.48@tcp:101:chmod.0 00010000:00010000:3.0:1790945519.903777:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945519.903794:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f2f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c80ea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.903849:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f2f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.903860:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.903868:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945519.903897:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790945519.903900:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790945519.903930:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.903954:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f2f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80ea expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.903984:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80ea expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945519.903992:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb851c9a200) 00010000:00010000:3.0:1790945519.903995:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945519.903998:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c5600, rc 0) 00000100:00100000:3.0:1790945519.904050:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:9682:x1877942254715008:12345-192.168.202.48@tcp:101:chmod.0 Request processed in 291us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945519.904057:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:2.0:1790945519.909120:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273625856 00000100:00100000:2.0:1790945519.909137:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273625856 00000100:00100000:0.0:1790945519.909141:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273625984 00000100:00100000:0.0:1790945519.909161:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273625984 00000100:00100000:0.0:1790945519.909215:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790945519.909230:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273625984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790945519.909273:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945519.909360:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273625984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (9142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945519.909521:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790945519.909542:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790945519.909549:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273625856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945519.909571:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945519.909796:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273625856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 247us (9670us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945519.909804:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1790945519.910528:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb86c931180 x1877942273625856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945519.910549:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273625856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945519.914242:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945519.914653:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254715264 00000100:00100000:0.0:1790945519.914697:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254715264 00000100:00100000:0.0:1790945519.914761:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 17 00000100:00100000:0.0:1790945519.914772:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:9682:x1877942254715264:12345-192.168.202.48@tcp:36:chmod.0 00010000:00010000:0.0:1790945519.914828:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945519.914862:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f2f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80ea expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.914882:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb851c9a200) 00010000:00010000:0.0:1790945519.914895:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945519.914920:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f2ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.914933:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f2ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.914953:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f2ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945519.915284:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000000dbc997 reply state 00000000a6316b85 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f2ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945519.915294:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790945519.915302:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790945519.915391:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:9682:x1877942254715264:12345-192.168.202.48@tcp:36:chmod.0 Request processed in 621us (1157us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1790945519.915399:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 17 00010000:00080000:1.0:1790945519.916054:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f8d880 x1877942273625984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945519.916076:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273625984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790945519.918600:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f2ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945519.918617:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f2ff lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945519.918636:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f2ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945519.918643:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945519.918648:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f2ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945519.918673:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f2ff lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945519.918693:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb8510c8b00) 00010000:00010000:1.0:1790945519.918696:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790945519.918700:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f2ff lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945519.918706:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f2ff lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945519.942502:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945519.942695:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254715392 00000100:00100000:0.0:1790945519.942706:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254715392 00000100:00100000:0.0:1790945519.942756:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 18 00000100:00100000:0.0:1790945519.942766:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:9683:x1877942254715392:12345-192.168.202.48@tcp:101:chown.0 00010000:00010000:0.0:1790945519.942789:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945519.942813:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c80f1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.942889:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f30d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.942903:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f30d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.942916:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f30d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945519.942949:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790945519.942965:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945519.943005:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f30d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.943033:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80f1 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.943050:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f30d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80f1 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.943058:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb8510c8600) 00010000:00010000:0.0:1790945519.943061:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945519.943064:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c200, rc 0) 00000100:00100000:0.0:1790945519.943121:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:9683:x1877942254715392:12345-192.168.202.48@tcp:101:chown.0 Request processed in 357us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945519.943128:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 18 00000100:00100000:2.0:1790945519.945584:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945519.945630:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254715520 00000100:00100000:3.0:1790945519.945639:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254715520 00000100:00100000:0.0:1790945519.945943:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 19 00000100:00100000:0.0:1790945519.945954:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:9683:x1877942254715520:12345-192.168.202.48@tcp:101:chown.0 00010000:00010000:0.0:1790945519.945973:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945519.945989:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f314 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c80f8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946054:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c800/0xc5cf2c2a6a54f31b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946092:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c800/0xc5cf2c2a6a54f31b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946104:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c800/0xc5cf2c2a6a54f31b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946191:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f322 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946212:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946219:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946308:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a54f329 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946313:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a54f329 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946317:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a54f329 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945519.946339:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790945519.946342:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945519.946354:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a54f329 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946362:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c800/0xc5cf2c2a6a54f31b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946366:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c800/0xc5cf2c2a6a54f31b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946371:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c800/0xc5cf2c2a6a54f31b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946392:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945519.946396:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c800/0xc5cf2c2a6a54f31b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946401:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c800/0xc5cf2c2a6a54f31b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946410:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb8510c8600) 00010000:00010000:0.0:1790945519.946412:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945519.946415:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c800/0xc5cf2c2a6a54f31b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946419:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c800/0xc5cf2c2a6a54f31b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946425:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946430:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f322 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946435:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f322 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946440:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945519.946442:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f322 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946447:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f322 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946464:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bb8510c8400) 00010000:00010000:0.0:1790945519.946466:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945519.946469:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f322 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946475:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f322 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946502:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f314 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80f8 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946511:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a54f329 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80f8 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945519.946515:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb8510c8300) 00010000:00010000:0.0:1790945519.946517:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945519.946518:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1de00, rc 0) 00000100:00100000:0.0:1790945519.946569:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:9683:x1877942254715520:12345-192.168.202.48@tcp:101:chown.0 Request processed in 617us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945519.946575:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 19 00000100:00100000:3.0:1790945519.948916:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945519.949018:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254715776 00000100:00100000:2.0:1790945519.949029:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254715776 00000100:00100000:2.0:1790945519.949076:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 20 00000100:00100000:2.0:1790945519.949083:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:9683:x1877942254715776:12345-192.168.202.48@tcp:36:chown.0 00010000:00010000:2.0:1790945519.949130:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945519.949147:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a54f329 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80f8 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945519.949159:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb8510c8300) 00010000:00010000:2.0:1790945519.949166:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945519.949182:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f330 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945519.949216:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f330 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945519.949223:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f330 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945519.983622:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1790945519.983871:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1790945519.983963:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001145fe1c reply state 00000000685e9a24 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f330 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945519.983973:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790945519.983986:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1790945519.984068:0:5824:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1790945519.984091:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:9683:x1877942254715776:12345-192.168.202.48@tcp:36:chown.0 Request processed in 35004us (35178us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790945519.984099:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 20 00010000:00010000:1.0:1790945519.984165:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f330 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945519.984175:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f330 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945519.984181:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f330 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945519.984187:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434ae600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945519.984191:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f330 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945519.984226:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f330 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945519.984240:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb845042400) 00010000:00010000:1.0:1790945519.984243:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790945519.984248:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f330 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945519.984254:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f330 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945519.999951:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945520.000376:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254715904 00000100:00100000:2.0:1790945520.000386:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254715904 00000100:00100000:2.0:1790945520.000494:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 21 00000100:00100000:2.0:1790945520.000508:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:9684:x1877942254715904:12345-192.168.202.48@tcp:101:touch.500 00010000:00010000:2.0:1790945520.000532:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945520.000552:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af800/0xc5cf2c2a6a54f337 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c80ff expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790945520.003907:0:7211:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3304us 00010000:00010000:1.0:1790945520.016998:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a54f33e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017020:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a54f33e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017032:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a54f33e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017047:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a54f345 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017054:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a54f345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017060:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a54f345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017403:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f34c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017420:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f34c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017428:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f34c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945520.017452:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790945520.017456:0:7211:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790945520.017494:0:7211:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f34c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017507:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a54f33e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017513:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a54f33e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017521:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a54f33e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017527:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167be00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945520.017531:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a54f33e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017539:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a54f33e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017552:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb8510c8600) 00010000:00010000:1.0:1790945520.017555:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945520.017560:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a54f33e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017578:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a54f33e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017588:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a54f345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017594:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a54f345 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017599:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a54f345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017604:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167b400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945520.017607:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a54f345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017613:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a54f345 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017620:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bb843765f00) 00010000:00010000:1.0:1790945520.017622:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945520.017625:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a54f345 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017631:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a54f345 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017693:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af800/0xc5cf2c2a6a54f337 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80ff expref: 8 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017709:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f34c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80ff expref: 7 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.017723:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb843765300) 00010000:00010000:1.0:1790945520.017725:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790945520.017728:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133600, rc 0) 00000100:00100000:1.0:1790945520.017803:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:9684:x1877942254715904:12345-192.168.202.48@tcp:101:touch.500 Request processed in 17298us (17861us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945520.017813:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 21 00000100:00100000:3.0:1790945520.021272:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945520.021452:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254716160 00000100:00100000:1.0:1790945520.021464:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254716160 00000100:00100000:1.0:1790945520.021525:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 22 00000100:00100000:1.0:1790945520.021536:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:9684:x1877942254716160:12345-192.168.202.48@tcp:101:touch.500 00010000:00010000:1.0:1790945520.021557:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945520.021577:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54f353 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8106 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.022002:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f35a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.022017:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f35a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.022028:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f35a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.022087:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f361 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.022094:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.022112:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790945520.023114:0:5825:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1790945520.023375:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54f368 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.023387:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54f368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.023396:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54f368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.023431:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f35a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.023439:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f35a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.023446:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f35a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.023451:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945520.023455:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f35a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.023461:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f35a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.023472:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb843765300) 00010000:00010000:1.0:1790945520.023475:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945520.023486:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f35a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.023493:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f35a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790945520.023505:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000031a2169d reply state 000000000e87a8e7 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945520.023511:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790945520.023536:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54f353 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8106 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.023544:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54f368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8106 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.023549:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb843765800) 00010000:00010000:1.0:1790945520.023550:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945520.023552:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133000, rc 0) 00000100:00100000:1.0:1790945520.023677:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:9684:x1877942254716160:12345-192.168.202.48@tcp:101:touch.500 Request processed in 2121us (2392us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790945520.023686:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 22 00010000:00010000:3.0:1790945520.025886:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.025904:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f361 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.025910:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f361 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.025931:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945520.025934:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f361 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.025942:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f361 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.025958:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff9bb843765500) 00010000:00010000:3.0:1790945520.025961:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945520.025965:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f361 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.025971:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f361 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945520.027577:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945520.027812:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254716416 00000100:00100000:0.0:1790945520.027822:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254716416 00000100:00100000:0.0:1790945520.027882:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 23 00000100:00100000:0.0:1790945520.027893:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:9684:x1877942254716416:12345-192.168.202.48@tcp:36:touch.500 00010000:00010000:0.0:1790945520.027965:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945520.027984:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54f368 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8106 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.028009:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb843765800) 00010000:00010000:0.0:1790945520.028020:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945520.028055:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f376 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.028066:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f376 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.028072:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f376 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945520.028185:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000006c9c9c5 reply state 000000005eb22217 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f376 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945520.028191:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945520.028299:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:9684:x1877942254716416:12345-192.168.202.48@tcp:36:touch.500 Request processed in 408us (730us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790945520.028306:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 23 00010000:00010000:2.0:1790945520.030032:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f376 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.030047:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f376 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.030069:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f376 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.030075:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945520.030080:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f376 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.030088:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f376 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.030102:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb8510c8400) 00010000:00010000:2.0:1790945520.030105:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945520.030110:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f376 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.030117:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f376 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945520.031965:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945520.032129:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254716544 00000100:00100000:2.0:1790945520.032139:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254716544 00000100:00100000:2.0:1790945520.032252:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 24 00000100:00100000:2.0:1790945520.032262:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:9684:x1877942254716544:12345-192.168.202.48@tcp:101:touch.500 00010000:00010000:2.0:1790945520.032288:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945520.032311:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54f37d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c810d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.032373:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54f37d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c810d expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.032420:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54f37d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c810d expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.032451:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb845042d00) 00010000:00010000:2.0:1790945520.032454:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945520.032457:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434aee00, rc 0) 00000100:00100000:2.0:1790945520.032512:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:9684:x1877942254716544:12345-192.168.202.48@tcp:101:touch.500 Request processed in 252us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945520.032519:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 24 00000100:00100000:1.0:1790945520.035641:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945520.035777:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254716672 00000100:00100000:3.0:1790945520.035788:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254716672 00000100:00100000:3.0:1790945520.035830:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:3.0:1790945520.035837:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2369:x1877942254716672:12345-192.168.202.48@tcp:8:touch.500 00010000:00080000:3.0:1790945520.035871:0:6670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:3.0:1790945520.035909:0:6670:0:(genops.c:1384:class_connect()) connect: client c6be5708-366a-4e39-b76f-5dba2d1f1a3b, cookie 0xc5cf2c2a6a54f384 00002000:00100000:3.0:1790945520.035935:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c6be5708-366a-4e39-b76f-5dba2d1f1a3b/ffff9bb87390d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790945520.035948:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790945520.036194:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790945520.036235:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9bb87390b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790945520.036329:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2369:x1877942254716672:12345-192.168.202.48@tcp:8:touch.500 Request processed in 489us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945520.036336:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:3.0:1790945520.039065:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945520.039238:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254716800 00000100:00100000:1.0:1790945520.039247:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254716800 00000100:00080000:0.0:1790945520.039367:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945520.039414:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 17 00000100:00100000:1.0:1790945520.039426:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:0:x1877942254716800:12345-192.168.202.48@tcp:2:touch.500 00000001:00080000:2.0:1790945520.078482:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1790945520.078499:0:7627:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000100:00100000:1.0:1790945520.078570:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:0:x1877942254716800:12345-192.168.202.48@tcp:2:touch.500 Request processed in 39141us (39507us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790945520.078596:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 17 00000100:00100000:1.0:1790945520.081997:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945520.082705:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254717056 00000100:00100000:0.0:1790945520.082717:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254717056 00000100:00100000:0.0:1790945520.082777:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:0.0:1790945520.082786:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:9684:x1877942254717056:12345-192.168.202.48@tcp:35:touch.500 00000100:00100000:0.0:1790945520.083126:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:9684:x1877942254717056:12345-192.168.202.48@tcp:35:touch.500 Request processed in 340us (1135us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790945520.083134:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:1.0:1790945520.106976:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945520.107063:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254717184 00000100:00100000:3.0:1790945520.107073:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254717184 00000100:00100000:3.0:1790945520.107132:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 25 00000100:00100000:3.0:1790945520.107141:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:9685:x1877942254717184:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:3.0:1790945520.107165:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945520.107190:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f38b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8114 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.107272:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f392 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.107288:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.107300:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945520.107343:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790945520.107347:0:7211:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790945520.107394:0:7211:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.107420:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f38b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8114 expref: 13 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.107508:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f392 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8114 expref: 12 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.107532:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb843765300) 00010000:00010000:3.0:1790945520.107535:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945520.107539:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4000, rc 0) 00000100:00100000:3.0:1790945520.107604:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:9685:x1877942254717184:12345-192.168.202.48@tcp:101:rm.0 Request processed in 463us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945520.107611:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 25 00000100:00100000:3.0:1790945520.114490:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945520.114640:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254717440 00000100:00100000:0.0:1790945520.114708:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254717440 00000100:00100000:0.0:1790945520.114820:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 26 00000100:00100000:0.0:1790945520.114832:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:9685:x1877942254717440:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:0.0:1790945520.114851:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945520.114869:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c811b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945520.114961:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790945520.115101:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f399 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c811b expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.115116:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb8510c8600) 00010000:00010000:0.0:1790945520.115119:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945520.115124:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c811b expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.115135:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1cc00, rc 0) 00000100:00100000:0.0:1790945520.115185:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:9685:x1877942254717440:12345-192.168.202.48@tcp:101:rm.0 Request processed in 356us (705us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1790945520.115192:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 26 00000100:00100000:1.0:1790945520.122938:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945520.123125:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254717568 00000100:00100000:3.0:1790945520.123136:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254717568 00000100:00100000:3.0:1790945520.123204:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3 00000100:00100000:3.0:1790945520.123215:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:9685:x1877942254717568:12345-192.168.202.48@tcp:37:rm.0 00000100:00100000:2.0:1790945520.128582:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:9685:x1877942254717568:12345-192.168.202.48@tcp:37:rm.0 Request processed in 5357us (5650us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945520.128595:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3 00000100:00100000:3.0:1790945520.134149:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945520.134263:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254717824 00000100:00100000:0.0:1790945520.134276:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254717824 00000100:00100000:0.0:1790945520.134335:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:0.0:1790945520.134345:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8477f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:9685:x1877942254717824:12345-192.168.202.48@tcp:35:rm.0 00000100:00100000:0.0:1790945520.134596:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8477f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:9685:x1877942254717824:12345-192.168.202.48@tcp:35:rm.0 Request processed in 252us (456us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790945520.134604:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:3.0:1790945520.148154:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945520.148314:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254718080 00000100:00100000:0.0:1790945520.148324:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254718080 00000100:00100000:0.0:1790945520.148378:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 27 00000100:00100000:0.0:1790945520.148388:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:9685:x1877942254718080:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:0.0:1790945520.148412:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945520.148430:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f3a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8122 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.148529:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f3ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.148543:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f3ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.148555:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f3ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945520.148564:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790945520.148843:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f3a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8122 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.148861:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f3ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8122 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.148869:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb843765300) 00010000:00010000:0.0:1790945520.148872:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790945520.148874:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d400, rc 0) 00000100:00100000:0.0:1790945520.148935:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:9685:x1877942254718080:12345-192.168.202.48@tcp:101:rm.0 Request processed in 549us (790us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1790945520.148959:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 27 00000100:00100000:1.0:1790945520.154343:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945520.158878:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254718208 00000100:00100000:2.0:1790945520.158894:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254718208 00000100:00100000:2.0:1790945520.158965:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 28 00000100:00100000:2.0:1790945520.158976:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:9685:x1877942254718208:12345-192.168.202.48@tcp:41:rm.0 00000004:00000024:2.0:1790945520.159035:0:5824:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1790945520.159117:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:9685:x1877942254718208:12345-192.168.202.48@tcp:41:rm.0 Request processed in 143us (4783us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945520.159125:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 28 00000100:00100000:3.0:1790945520.165404:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945520.165586:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254718336 00000100:00100000:1.0:1790945520.165595:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254718336 00000100:00100000:1.0:1790945520.165716:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 29 00000100:00100000:1.0:1790945520.165728:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:9685:x1877942254718336:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:1.0:1790945520.165753:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945520.165775:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f3bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8129 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.165835:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132e00/0xc5cf2c2a6a54f3c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.165847:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132e00/0xc5cf2c2a6a54f3c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.165856:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132e00/0xc5cf2c2a6a54f3c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.165866:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132600/0xc5cf2c2a6a54f3ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.165870:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132600/0xc5cf2c2a6a54f3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.165874:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132600/0xc5cf2c2a6a54f3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.165982:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f3d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.165988:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.165993:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945520.166017:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790945520.166020:0:7211:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790945520.166039:0:7211:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166047:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166053:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132e00/0xc5cf2c2a6a54f3c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166059:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132e00/0xc5cf2c2a6a54f3c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166063:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132e00/0xc5cf2c2a6a54f3c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166067:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945520.166070:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132e00/0xc5cf2c2a6a54f3c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166075:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132e00/0xc5cf2c2a6a54f3c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166089:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb843765300) 00010000:00010000:1.0:1790945520.166091:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945520.166094:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132e00/0xc5cf2c2a6a54f3c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166098:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132e00/0xc5cf2c2a6a54f3c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166107:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132600/0xc5cf2c2a6a54f3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166110:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132600/0xc5cf2c2a6a54f3ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166114:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132600/0xc5cf2c2a6a54f3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166117:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945520.166119:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132600/0xc5cf2c2a6a54f3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166122:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132600/0xc5cf2c2a6a54f3ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166125:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff9bb843765f00) 00010000:00010000:1.0:1790945520.166127:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945520.166128:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132600/0xc5cf2c2a6a54f3ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166131:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132600/0xc5cf2c2a6a54f3ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166170:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f3bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8129 expref: 18 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166189:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8129 expref: 17 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.166195:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb845042d00) 00010000:00010000:1.0:1790945520.166205:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945520.166208:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133200, rc 0) 00000100:00100000:1.0:1790945520.166384:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+17:9685:x1877942254718336:12345-192.168.202.48@tcp:101:rm.0 Request processed in 658us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945520.166392:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 29 00000100:00100000:3.0:1790945520.171378:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945520.171506:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254718592 00000100:00100000:2.0:1790945520.171516:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254718592 00000100:00100000:2.0:1790945520.171572:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 30 00000100:00100000:2.0:1790945520.171589:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+17:9685:x1877942254718592:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:2.0:1790945520.171641:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790945520.171702:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f3d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8129 expref: 17 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.171726:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54f37d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c810d expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.171737:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb845042d00) 00010000:00010000:2.0:1790945520.171751:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f392 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8114 expref: 15 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.171760:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb843765300) 00010000:00010000:2.0:1790945520.171763:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945520.171783:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f3d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.171795:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.171804:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.171817:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f3df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.171823:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.171829:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.171961:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f3e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.171970:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.171977:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790945520.172991:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1790945520.173003:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 265968345048ns, next at 266968342891ns, rc = 0 00010000:00010000:2.0:1790945520.173056:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f3ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173068:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f3ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173076:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f3ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173084:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f3ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173091:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f3ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173097:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f3ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173118:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945520.173136:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173149:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f3e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173156:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f3e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173161:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945520.173166:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f3e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173174:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f3e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.173262:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945520.173268:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f3ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.173275:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434afa00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945520.173278:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f3ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.173284:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f3ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.173294:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb845042700) 00010000:00010000:1.0:1790945520.173297:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790945520.173301:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f3ed lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.173307:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f3ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945520.173322:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945520.173324:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945520.173326:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945520.173348:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bb845042700) 00010000:00010000:2.0:1790945520.173350:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790945520.173353:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f3e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173359:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f3e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173378:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173384:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f3d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173390:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f3d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173394:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945520.173401:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f3d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173407:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f3d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173415:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb843765300) 00010000:00010000:2.0:1790945520.173418:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945520.173420:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f3d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.173427:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f3d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945520.173436:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000086e7e91f reply state 0000000001deb59e transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945520.173445:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790945520.173569:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:9685:x1877942254718592:12345-192.168.202.48@tcp:36:rm.0 Request processed in 1977us (2196us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790945520.173579:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 30 00010000:00010000:3.0:1790945520.180296:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.180315:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f3df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.180323:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f3df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.180329:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434aea00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945520.180335:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f3df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.180361:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f3df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.180388:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff9bb845042500) 00010000:00010000:3.0:1790945520.180392:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945520.180397:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f3df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.180403:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f3df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945520.181889:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945520.181959:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254718848 00000100:00100000:2.0:1790945520.181970:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254718848 00000100:00100000:2.0:1790945520.182023:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:2.0:1790945520.182033:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:9685:x1877942254718848:12345-192.168.202.48@tcp:35:rm.0 00000100:00100000:2.0:1790945520.182279:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:9685:x1877942254718848:12345-192.168.202.48@tcp:35:rm.0 Request processed in 245us (395us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790945520.182287:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:2.0:1790945520.193777:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945520.193865:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254719104 00000100:00100000:0.0:1790945520.193876:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254719104 00000100:00100000:0.0:1790945520.193945:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 31 00000100:00100000:0.0:1790945520.193956:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:9685:x1877942254719104:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:0.0:1790945520.194014:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790945520.194040:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f3ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8122 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.194062:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f34c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80ff expref: 15 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.194074:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb843765300) 00010000:00010000:0.0:1790945520.194094:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f30d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80f1 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.194103:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb8510c8600) 00010000:00010000:0.0:1790945520.194111:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945520.194134:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f3f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.194148:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f3f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.194157:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f3f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.194169:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c600/0xc5cf2c2a6a54f3fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.194190:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c600/0xc5cf2c2a6a54f3fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.194206:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c600/0xc5cf2c2a6a54f3fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.194460:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f402 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.194469:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f402 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.194476:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f402 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945520.195219:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790945520.195239:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f402 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.195247:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f402 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.195255:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f402 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.195261:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945520.195266:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f402 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.195274:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f402 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.195296:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bb8510c8000) 00010000:00010000:0.0:1790945520.195299:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790945520.195304:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f402 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.195310:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f402 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.195330:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f3f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.195336:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f3f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.195342:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f3f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.195347:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945520.195350:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f3f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.195356:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f3f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.195363:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:0.0:1790945520.195365:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945520.195369:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f3f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945520.195374:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f3f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945520.195396:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003ef4752b reply state 00000000c77a7207 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c600/0xc5cf2c2a6a54f3fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945520.195404:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945520.195886:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:9685:x1877942254719104:12345-192.168.202.48@tcp:36:rm.0 Request processed in 1928us (2115us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790945520.195895:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 31 00010000:00010000:2.0:1790945520.198728:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c600/0xc5cf2c2a6a54f3fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.198755:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c600/0xc5cf2c2a6a54f3fb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.198763:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c600/0xc5cf2c2a6a54f3fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.198769:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945520.198775:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c600/0xc5cf2c2a6a54f3fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.198782:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c600/0xc5cf2c2a6a54f3fb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.198797:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bb8510c8500) 00010000:00010000:2.0:1790945520.198800:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945520.198803:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c600/0xc5cf2c2a6a54f3fb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945520.198809:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c600/0xc5cf2c2a6a54f3fb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945520.348179:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945521.301260:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945521.301298:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945521.301331:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945521.301354:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945521.301388:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254719232 00000100:00100000:2.0:1790945521.301398:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254719232 00000100:00100000:2.0:1790945521.301460:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 247 00000100:00100000:2.0:1790945521.301469:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254719232:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945521.301547:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254719232:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 78us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945521.301555:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 247 00000100:00100000:2.0:1790945521.301587:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254719488 00000100:00100000:2.0:1790945521.301590:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254719488 00000100:00100000:2.0:1790945521.301617:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 53 00000100:00100000:2.0:1790945521.301623:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254719488:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945521.301651:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254719488:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945521.301675:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 53 00000100:00100000:2.0:1790945521.301692:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254719360 00000100:00100000:2.0:1790945521.301696:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254719360 00000100:00100000:2.0:1790945521.301727:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254719616 00000100:00100000:2.0:1790945521.301730:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254719616 00000100:00100000:2.0:1790945521.301750:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 95 00000100:00100000:2.0:1790945521.301756:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:2370:x1877942254719360:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945521.301759:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 96 00000100:00100000:0.0:1790945521.301767:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254719616:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945521.301788:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:2370:x1877942254719360:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 32us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945521.301789:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254719616:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945521.301794:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 95 00000100:00100000:0.0:1790945521.302229:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 96 00000100:00080000:3.0:1790945521.302467:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790945521.372842:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945522.402169:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945523.420121:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790945524.173466:0:11605:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1790945524.443899:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945524.508008:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945524.508111:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273626240:0@lo:400:kworker.0 00000100:00100000:3.0:1790945524.508224:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945524.508303:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945524.508310:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273626368:0@lo:400:kworker.0 00000100:00100000:3.0:1790945524.508346:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945524.508545:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945524.508558:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273626496:0@lo:400:kworker.0 00000100:00100000:2.0:1790945524.508594:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945524.508649:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273626240 00000100:00100000:2.0:1790945524.508678:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273626240 00000100:00100000:2.0:1790945524.508721:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273626368 00000100:00100000:2.0:1790945524.508725:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273626368 00000100:00100000:2.0:1790945524.508778:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790945524.508786:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273626240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945524.508840:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273626240:12345-0@lo:400:kworker.0 Request processed in 54us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945524.508848:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790945524.508865:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790945524.508871:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273626368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945524.508899:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273626368:12345-0@lo:400:kworker.0 Request processed in 29us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945524.508905:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1790945524.508928:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945524.508961:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273626368:0@lo:400:kworker.0 00000100:00100000:2.0:1790945524.508974:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273626240:0@lo:400:kworker.0 00000100:00100000:3.0:1790945524.509132:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273626496 00000100:00100000:3.0:1790945524.509136:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273626496 00000100:00100000:3.0:1790945524.509188:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790945524.509195:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273626496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945524.509229:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273626496:12345-0@lo:400:kworker.0 Request processed in 34us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945524.509235:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1790945524.509692:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790945524.509716:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb881930a80 x1877942273626496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945524.509727:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273626496:0@lo:400:kworker.0 00000100:00100000:1.0:1790945524.512646:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273626112:0@lo:400:kworker.0 00000100:00100000:1.0:1790945524.512743:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945524.512893:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273626112 00000100:00100000:2.0:1790945524.512902:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273626112 00000100:00100000:2.0:1790945524.512953:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1790945524.512963:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273626112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945524.513034:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273626112:12345-0@lo:400:kworker.0 Request processed in 72us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945524.513042:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1790945524.513140:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273626112:0@lo:400:kworker.0 00000100:00100000:1.0:1790945524.514745:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273626752:0@lo:400:kworker.0 00000100:00100000:1.0:1790945524.514803:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945524.514894:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945524.514905:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273626624:0@lo:400:kworker.0 00000100:00100000:3.0:1790945524.514935:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945524.515009:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273626624 00000100:00100000:1.0:1790945524.515017:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273626624 00000100:00100000:1.0:1790945524.515071:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790945524.515079:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273626624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945524.515126:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273626624:12345-0@lo:400:kworker.0 Request processed in 47us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945524.515132:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790945524.515188:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273626624:0@lo:400:kworker.0 00000100:00080000:3.0:1790945524.515259:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945524.515501:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273626752 00000100:00100000:0.0:1790945524.515506:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273626752 00000100:00100000:0.0:1790945524.515551:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790945524.515559:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273626752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945524.515609:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273626752:12345-0@lo:400:kworker.0 Request processed in 51us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945524.515614:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1790945524.515691:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb874acbb80 x1877942273626752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945524.515703:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273626752:0@lo:400:kworker.0 00000100:00080000:3.0:1790945524.515756:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945525.023763:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945525.023788:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273626880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945525.023857:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945525.023926:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273626880 00000100:00100000:3.0:1790945525.023933:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273626880 00000100:00100000:3.0:1790945525.023980:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790945525.023989:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273626880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945525.024022:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790945525.024068:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273626880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945525.024075:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1790945525.024115:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb873a13100 x1877942273626880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945525.024133:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273626880:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1790945525.028880:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 270824220281ns, next at 271824217798ns, rc = 0 00000100:00100000:2.0:1790945525.028949:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945525.028987:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273627008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945525.029058:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945525.029397:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273627008 00000100:00100000:0.0:1790945525.029407:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273627008 00000100:00100000:0.0:1790945525.029458:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790945525.029468:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273627008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945525.029517:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945525.029580:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273627008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945525.029587:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1790945525.029748:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb874ac9180 x1877942273627008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945525.029768:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273627008:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1790945525.100097:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1790945525.100134:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1790945525.100310:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273627136:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790945525.100377:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945525.100552:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273627136 00000100:00100000:2.0:1790945525.100561:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273627136 00000100:00100000:2.0:1790945525.100612:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790945525.100621:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273627136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790945525.100649:0:7919:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1790945525.100700:0:7919:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6abfa8f0, atime: 0x6abfa8f0, ctime: 0x6abfa8f0, blocks: 0x1 00010000:00010000:2.0:1790945525.100709:0:7919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f409 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945525.100725:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=270s v=(0 0) 00010000:00010000:2.0:1790945525.100730:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945525.100736:0:7919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945525.100752:0:7919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945525.100762:0:7919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945525.100770:0:7919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f409 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945525.100805:0:7919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790945525.100881:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945525.100889:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f409 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.100900:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af600 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945525.100905:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f409 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.100916:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f409 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.100935:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f409 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.100944:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f409 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.100967:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945525.100970:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945525.100974:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945525.101361:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3295:x1877942273627136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 739us (982us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790945525.101370:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1790945525.102568:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb88133f800/2, rc 0, transno 4294967300 00000100:00100000:3.0:1790945525.102579:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273627136:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1790945525.469165:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790945525.528394:0:11654:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca3ada5e0 20000000:00000080:3.0:1790945525.528417:0:11654:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb87b494400 uarg=0000000000000000 20000000:01000000:3.0:1790945525.528452:0:11654:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790945525.528459:0:11654:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790945525.528464:0:11654:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1790945525.529479:0:11655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1790945525.529616:0:11654:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1790945525.538103:0:11654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1790945525.538176:0:11654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1790945525.538245:0:11654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1790945525.538260:0:11654:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790945525.538279:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.538297:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8434ae400/0xc5cf2c2a6a54f2b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f2ab expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.538305:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb84167a400/0xc5cf2c2a6a54f2c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f2b9 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.538312:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f2c7 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.538322:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f2d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80dc expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.538340:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f2dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80e3 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.538348:0:11654:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.538395:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f2dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80e3 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.538410:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f2dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80e3 expref: 12 pid: 5818 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945525.538424:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1877942273627264:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945525.538521:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f2d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80dc expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.538535:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f2d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80dc expref: 12 pid: 5817 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945525.538544:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1877942273627392:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945525.538581:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2c7 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.538590:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2c7 expref: 18 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945525.538599:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1877942273627520:0@lo:104: 00000100:00100000:0.0:1790945525.538636:0:11654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790945525.538700:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb84167a400/0xc5cf2c2a6a54f2c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2b9 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.538709:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb84167a400/0xc5cf2c2a6a54f2c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2b9 expref: 18 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945525.538716:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874aca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1877942273627648:0@lo:104: 00000100:00100000:0.0:1790945525.538736:0:11654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790945525.538759:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb8434ae400/0xc5cf2c2a6a54f2b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2ab expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.538767:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bb8434ae400/0xc5cf2c2a6a54f2b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2ab expref: 18 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945525.538775:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1877942273627776:0@lo:104: 00000100:00100000:0.0:1790945525.538798:0:11654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945525.538841:0:8439:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790945525.538852:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273627520 00000100:00100000:0.0:1790945525.538859:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273627520 00000100:00100000:0.0:1790945525.538897:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273627648 00000100:00100000:0.0:1790945525.538900:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273627648 00000100:00100000:0.0:1790945525.538909:0:8439:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273627776 00000100:00100000:0.0:1790945525.538911:0:8439:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273627776 00000100:00100000:0.0:1790945525.538923:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790945525.538931:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+5:11654:x1877942273627520:12345-0@lo:104: 00010000:00010000:0.0:1790945525.538943:0:8439:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f2ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.538988:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790945525.538994:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+5:11654:x1877942273627520:12345-0@lo:104: Request processed in 63us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945525.539000:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790945525.539017:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790945525.539022:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:11654:x1877942273627648:12345-0@lo:104: 00010000:00010000:0.0:1790945525.539029:0:8439:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f2c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539060:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790945525.539065:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+4:11654:x1877942273627648:12345-0@lo:104: Request processed in 44us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945525.539071:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790945525.539083:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790945525.539089:0:8439:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa13450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:11654:x1877942273627776:12345-0@lo:104: 00010000:00010000:0.0:1790945525.539096:0:8439:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f2b2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539130:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790945525.539135:0:8439:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa13450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+3:11654:x1877942273627776:12345-0@lo:104: Request processed in 46us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945525.539141:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1790945525.539193:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790945525.539200:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f2ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539208:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c400 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1790945525.539211:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f2ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539220:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f2ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945525.539226:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f2ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945525.539232:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790945525.539258:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f2ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539265:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945525.539284:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f2ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539290:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c400/0xc5cf2c2a6a54f2c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f2ce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539311:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790945525.539314:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f2c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539319:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434ae000 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1790945525.539322:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f2c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539328:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f2c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945525.539334:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f2c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945525.539338:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790945525.539350:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f2c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539355:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945525.539360:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f2c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539366:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae000/0xc5cf2c2a6a54f2b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f2c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539374:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945525.539377:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a54f2b2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539392:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167a600 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1790945525.539395:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a54f2b2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539401:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a54f2b2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945525.539407:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a54f2b2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945525.539412:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790945525.539425:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f2b2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539430:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945525.539445:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f2b2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539451:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb84167a600/0xc5cf2c2a6a54f2ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a54f2b2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539469:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945525.539471:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945525.539472:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945525.539478:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945525.539496:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273628032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945525.539525:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945525.539546:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945525.539552:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273627904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945525.539579:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945525.539603:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273628160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945525.539625:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945525.539649:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273628032 00000100:00100000:0.0:1790945525.539653:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273628032 00010000:00010000:0.0:1790945525.539702:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb84167a400/0xc5cf2c2a6a54f2c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2b9 expref: 19 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945525.539721:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273627904 00000100:00100000:0.0:1790945525.539724:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273627904 00010000:00010000:0.0:1790945525.539733:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2c7 expref: 20 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945525.539744:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273628160 00000100:00100000:0.0:1790945525.539746:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273628160 00010000:00010000:0.0:1790945525.539755:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb8434ae400/0xc5cf2c2a6a54f2b2 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2ab expref: 21 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945525.539766:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790945525.539771:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+21:3293:x1877942273628032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790945525.539780:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945525.539785:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb84167a400/0xc5cf2c2a6a54f2c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2b9 expref: 21 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539793:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb84167a400/0xc5cf2c2a6a54f2c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2b9 expref: 21 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539807:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945525.539834:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+21:3293:x1877942273628032:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945525.539849:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790945525.539862:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790945525.539867:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+20:3293:x1877942273627904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790945525.539874:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945525.539878:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2c7 expref: 20 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539887:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2c7 expref: 20 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539896:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945525.539917:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+20:3293:x1877942273627904:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945525.539923:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790945525.539933:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790945525.539938:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273628160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790945525.539945:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945525.539949:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb8434ae400/0xc5cf2c2a6a54f2b2 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2ab expref: 19 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539956:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb8434ae400/0xc5cf2c2a6a54f2b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2ab expref: 19 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945525.539965:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945525.539987:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273628160:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945525.539993:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790945525.540045:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273628160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945525.540078:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273627904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945525.540085:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273628032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945525.540122:0:11654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8528ca3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790945525.540136:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a54f2ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2c7 expref: 18 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945525.540161:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1877942273627520:0@lo:104: 00010000:00010000:0.0:1790945525.540172:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167a400/0xc5cf2c2a6a54f2c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2b9 expref: 17 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945525.540179:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874aca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1877942273627648:0@lo:104: 00010000:00010000:0.0:1790945525.540187:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8434ae400/0xc5cf2c2a6a54f2b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a54f2ab expref: 16 pid: 5817 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945525.540195:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1877942273627776:0@lo:104: 00000100:00100000:3.0:1790945525.544940:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945525.544973:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945525.545012:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254719872 00000100:00100000:3.0:1790945525.545022:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254719872 00010000:00010000:3.0:1790945525.545060:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f2d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80dc expref: 13 pid: 5817 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945525.545090:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254719744 00000100:00100000:3.0:1790945525.545093:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254719744 00010000:00010000:3.0:1790945525.545104:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f2dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80e3 expref: 14 pid: 5818 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945525.545121:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00100000:3.0:1790945525.545130:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee3b157-ad31-4030-99ec-031c727e7689+14:2372:x1877942254719872:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945525.545155:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945525.545161:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f2d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80dc expref: 14 pid: 5817 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945525.545172:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f2d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80dc expref: 14 pid: 5817 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945525.545193:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945525.545251:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee3b157-ad31-4030-99ec-031c727e7689+14:2372:x1877942254719872:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 121us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945525.545274:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00100000:3.0:1790945525.545293:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 34 00000100:00100000:3.0:1790945525.545299:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee3b157-ad31-4030-99ec-031c727e7689+13:2372:x1877942254719744:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945525.545307:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945525.545311:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f2dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80e3 expref: 13 pid: 5818 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945525.545320:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f2dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80e3 expref: 13 pid: 5818 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945525.545339:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945525.545347:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945525.545362:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945525.545368:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945525.545374:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945525.546106:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945525.546114:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945525.546128:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945525.546137:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945525.546157:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945525.546170:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945525.546205:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee3b157-ad31-4030-99ec-031c727e7689+13:2372:x1877942254719744:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 903us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945525.546213:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 34 00010000:00010000:1.0:1790945525.546651:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167ae00/0xc5cf2c2a6a54f2dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80e3 expref: 12 pid: 5818 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945525.546703:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1877942273627264:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945525.546719:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a54f2d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80dc expref: 11 pid: 5817 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945525.546727:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1877942273627392:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945525.546757:0:11654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945525.546767:0:11654:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945525.546773:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945525.546779:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f410 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945525.607571:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:3.0:1790945526.427123:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945526.427202:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945526.427309:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254720000 00000100:00100000:0.0:1790945526.427328:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254720000 00000100:00100000:0.0:1790945526.427387:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 249 00000100:00100000:0.0:1790945526.427398:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+11:2370:x1877942254720000:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945526.427481:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+11:2370:x1877942254720000:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 85us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945526.427490:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 249 00000100:00100000:2.0:1790945526.427743:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254720256 00000100:00100000:2.0:1790945526.427758:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254720256 00000100:00100000:2.0:1790945526.427811:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 56 00000100:00100000:2.0:1790945526.427819:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254720256:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945526.427855:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254720256:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 37us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945526.427861:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 56 00000100:00080000:0.0:1790945526.427996:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945526.442811:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945526.442861:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945526.442959:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254720128 00000100:00100000:0.0:1790945526.442970:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254720128 00000100:00100000:0.0:1790945526.443034:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254720384 00000100:00100000:0.0:1790945526.443052:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254720384 00000100:00100000:0.0:1790945526.443093:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 100 00000100:00100000:0.0:1790945526.443102:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2371:x1877942254720128:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945526.443198:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2371:x1877942254720128:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 96us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945526.443205:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 100 00000100:00100000:0.0:1790945526.443220:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 101 00000100:00100000:0.0:1790945526.443225:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254720384:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945526.443264:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254720384:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 37us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945526.443270:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 101 00000100:00080000:3.0:1790945526.443849:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790945526.492684:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790945527.131778:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790945527.131877:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb87fbcd800 from 7 10000000:01000000:0.0:1790945527.131882:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790945527.131929:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945527.131941:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945527.131952:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945527.131977:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273628288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790945527.132167:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945527.132285:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843442d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790945527.135178:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273628288 00000100:00100000:1.0:1790945527.135194:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273628288 00000100:00100000:1.0:1790945527.135472:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1790945527.135483:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:5820:x1877942273628288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945527.135501:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945527.135521:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb87b132000/0xc5cf2c2a6a54f41e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f417 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945527.135548:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb87b132000/0xc5cf2c2a6a54f41e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f417 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945527.135575:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb87b132000/0xc5cf2c2a6a54f41e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f417 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945527.135584:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132000, rc 0) 00000100:00100000:1.0:1790945527.135690:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273628288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (3523us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945527.135697:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1790945527.135808:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273628288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945527.135827:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945527.135837:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945527.135903:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273628416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945527.135935:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945527.143944:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273628416 00000100:00100000:0.0:1790945527.143975:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273628416 00000100:00100000:2.0:1790945527.143992:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8603fe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945527.144030:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1790945527.144039:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273628416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945527.144342:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273628416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (8404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945527.144351:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1790945527.144514:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273628416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945527.144564:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273628544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945527.144612:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945527.144632:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8603fe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945527.144745:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273628544 00000100:00100000:0.0:1790945527.144749:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273628544 00000100:00100000:0.0:1790945527.144813:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1790945527.144821:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273628544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945527.144973:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273628544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945527.144980:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790945527.145043:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273628544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945527.145226:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:11668:1877942273628672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945527.145260:0:11668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945527.148552:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8603fe180 going to sleep for 11 seconds 00000100:00100000:3.0:1790945527.148681:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273628672 00000100:00100000:3.0:1790945527.148692:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273628672 00000100:00100000:3.0:1790945527.148753:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1790945527.148762:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:11668:x1877942273628672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945527.149006:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:11668:x1877942273628672:12345-0@lo:502:llog_process_th.0 Request processed in 245us (3745us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945527.149013:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1790945527.149119:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:11668:1877942273628672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945527.149157:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945527.149166:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945527.149168:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790945527.149175:0:11668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bb87fbcd800 00000020:00000080:2.0:1790945527.149178:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790945527.149263:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:11668:1877942273628800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945527.149301:0:11668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945527.149319:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8603fe180 going to sleep for 11 seconds 00000100:00100000:2.0:1790945527.150844:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273628800 00000100:00100000:2.0:1790945527.150853:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273628800 00000100:00100000:2.0:1790945527.150885:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1790945527.150894:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:11668:x1877942273628800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945527.151095:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:11668:x1877942273628800:12345-0@lo:502:llog_process_th.0 Request processed in 201us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945527.151102:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1790945527.151167:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:11668:1877942273628800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945527.151194:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945527.151201:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945527.151208:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790945527.151213:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1790945527.151272:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1790945527.151288:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945527.151298:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945527.151310:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945527.151320:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790945527.151322:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb8654d2800 from 7 10000000:01000000:2.0:1790945527.151325:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790945527.151351:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945527.151360:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945527.151369:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945527.151385:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273628928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790945527.151417:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945527.156598:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8603fe180 going to sleep for 11 seconds 00000100:00100000:2.0:1790945527.156630:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273628928 00000100:00100000:2.0:1790945527.156640:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273628928 00000100:00100000:2.0:1790945527.156700:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1790945527.156708:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:5820:x1877942273628928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945527.156725:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945527.156748:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8434afe00/0xc5cf2c2a6a54f42c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f425 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945527.156776:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8434afe00/0xc5cf2c2a6a54f42c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f425 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945527.156787:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8434afe00/0xc5cf2c2a6a54f42c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f425 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945527.156796:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434afe00, rc 0) 00000100:00100000:2.0:1790945527.156858:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273628928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945527.156865:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1790945527.156914:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273628928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945527.156932:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945527.156941:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945527.157003:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273629056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945527.157038:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945527.157052:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8603fe180 going to sleep for 11 seconds 00000100:00100000:2.0:1790945527.157063:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273629056 00000100:00100000:2.0:1790945527.157066:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273629056 00000100:00100000:2.0:1790945527.157080:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1790945527.157085:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273629056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945527.157319:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273629056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945527.157331:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1790945527.157359:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273629056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945527.157383:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273629184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790945527.157417:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945527.157572:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8603fe180 going to sleep for 11 seconds 00000100:00100000:0.0:1790945527.158778:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273629184 00000100:00100000:0.0:1790945527.158788:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273629184 00000100:00100000:1.0:1790945527.163552:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1790945527.163570:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273629184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945527.163825:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273629184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 261us (6406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945527.163833:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1790945527.163902:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273629184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945527.164084:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:11671:1877942273629312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945527.164126:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945527.164162:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273629312 00000100:00100000:1.0:1790945527.164167:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273629312 00000100:00100000:1.0:1790945527.164189:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1790945527.164195:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:11671:x1877942273629312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945527.164313:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:11671:x1877942273629312:12345-0@lo:502:llog_process_th.0 Request processed in 117us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945527.164320:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1790945527.164357:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945527.164368:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:11671:1877942273629312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790945527.164393:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945527.164402:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945527.164405:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790945527.164411:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bb8654d2800 00000020:00000080:1.0:1790945527.164413:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790945527.164847:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:11671:1877942273629440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945527.164882:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945527.164902:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273629440 00000100:00100000:1.0:1790945527.164906:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273629440 00000100:00100000:1.0:1790945527.164922:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1790945527.164928:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:11671:x1877942273629440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945527.165043:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:11671:x1877942273629440:12345-0@lo:502:llog_process_th.0 Request processed in 114us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945527.165049:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1790945527.165076:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945527.165088:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:11671:1877942273629440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790945527.165106:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945527.165121:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945527.165122:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790945527.165125:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790945527.165177:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790945527.165201:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790945527.165212:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945527.165223:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945527.165241:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790945527.165244:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb845514800 from 7 10000000:01000000:1.0:1790945527.165247:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790945527.165268:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945527.165273:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945527.165279:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945527.165287:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273629568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790945527.165306:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945527.165320:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945527.165332:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273629568 00000100:00100000:1.0:1790945527.165335:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273629568 00000100:00100000:1.0:1790945527.165350:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1790945527.165356:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:5820:x1877942273629568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945527.165365:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945527.165377:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb87b132600/0xc5cf2c2a6a54f43a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a54f433 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945527.165399:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb87b132600/0xc5cf2c2a6a54f43a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f433 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945527.165409:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb87b132600/0xc5cf2c2a6a54f43a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f433 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945527.165426:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132600, rc 0) 00000100:00100000:1.0:1790945527.165454:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273629568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945527.165460:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1790945527.165487:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273629568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945527.165499:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945527.165507:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945527.165544:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273629696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945527.165568:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945527.165581:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945527.165591:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273629696 00000100:00100000:1.0:1790945527.165594:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273629696 00000100:00100000:1.0:1790945527.165609:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790945527.165615:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273629696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945527.165826:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273629696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945527.165833:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790945527.165861:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273629696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945527.165883:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273629824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945527.165917:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945527.165938:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945527.165949:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273629824 00000100:00100000:1.0:1790945527.165953:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273629824 00000100:00100000:1.0:1790945527.165969:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790945527.165974:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273629824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945527.166073:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:5820:x1877942273629824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945527.166080:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790945527.166108:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:5820:1877942273629824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945527.166313:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:11672:1877942273629952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945527.166345:0:11672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945527.166362:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273629952 00000100:00100000:1.0:1790945527.166365:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273629952 00000100:00100000:1.0:1790945527.166381:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790945527.166387:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:11672:x1877942273629952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945527.166490:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:11672:x1877942273629952:12345-0@lo:502:llog_process_th.0 Request processed in 103us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945527.166497:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790945527.166522:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb88133bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790945527.166532:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:11672:1877942273629952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790945527.166550:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945527.166557:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945527.166559:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790945527.166564:0:11672:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bb845514800 00000020:00000080:1.0:1790945527.166566:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790945527.166924:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:11672:1877942273630080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945527.166964:0:11672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945527.166983:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273630080 00000100:00100000:1.0:1790945527.166986:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273630080 00000100:00100000:1.0:1790945527.167004:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790945527.167009:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:11672:x1877942273630080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945527.167113:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:11672:x1877942273630080:12345-0@lo:502:llog_process_th.0 Request processed in 104us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945527.167118:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790945527.169358:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb88133bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790945527.179008:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb872fec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:11672:1877942273630080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945527.179069:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945527.179077:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945527.179080:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790945527.179085:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790945527.184609:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790945527.184646:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790945527.184808:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945527.184891:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790945527.187219:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790945527.379411:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945527.379795:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254720512 00000100:00100000:0.0:1790945527.379805:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254720512 00000100:00100000:0.0:1790945527.379866:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 265 00000100:00100000:0.0:1790945527.379877:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+11:5615:x1877942254720512:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945527.379895:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945527.379912:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865d1c800/0xc5cf2c2a6a54f441 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8130 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945527.379940:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1c800/0xc5cf2c2a6a54f441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8130 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945527.379952:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865d1c800/0xc5cf2c2a6a54f441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8130 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945527.379981:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c800, rc 0) 00000100:00100000:0.0:1790945527.380045:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+12:5615:x1877942254720512:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 169us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945527.380052:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 265 00000100:00100000:0.0:1790945527.386578:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945527.387293:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254720640 00000100:00100000:1.0:1790945527.387410:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254720640 00000100:00100000:2.0:1790945527.387754:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 266 00000100:00100000:2.0:1790945527.387765:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+12:5615:x1877942254720640:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945527.388023:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+12:5615:x1877942254720640:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 259us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945527.388032:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 266 00000100:00100000:1.0:1790945527.392721:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945527.393329:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254720768 00000100:00100000:3.0:1790945527.393341:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254720768 00000100:00100000:3.0:1790945527.393408:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 267 00000100:00100000:3.0:1790945527.393418:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+12:5615:x1877942254720768:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945527.394594:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+12:5615:x1877942254720768:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 1172us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945527.394614:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 267 00000100:00100000:1.0:1790945527.399524:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945527.399700:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254720896 00000100:00100000:2.0:1790945527.399711:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254720896 00000100:00100000:2.0:1790945527.399771:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 268 00000100:00100000:2.0:1790945527.399782:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8654b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+12:9955:x1877942254720896:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790945527.400086:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8654b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+12:9955:x1877942254720896:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 305us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945527.400094:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 268 00000100:00100000:0.0:1790945527.409202:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945527.409724:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254721024 00000100:00100000:3.0:1790945527.409735:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254721024 00000100:00100000:3.0:1790945527.409788:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 269 00000100:00100000:3.0:1790945527.409798:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+12:9955:x1877942254721024:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790945527.410119:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+12:9955:x1877942254721024:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 320us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945527.410137:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 269 00000100:00100000:1.0:1790945527.420936:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945527.422169:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254721152 00000100:00100000:2.0:1790945527.422193:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254721152 00000100:00100000:2.0:1790945527.422318:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 270 00000100:00100000:2.0:1790945527.422329:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+12:5615:x1877942254721152:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945527.422346:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945527.422363:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8434af800/0xc5cf2c2a6a54f448 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8137 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945527.422394:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8434af800/0xc5cf2c2a6a54f448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8137 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945527.422405:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8434af800/0xc5cf2c2a6a54f448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8137 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945527.422413:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434af800, rc 0) 00000100:00100000:2.0:1790945527.422484:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:5615:x1877942254721152:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 155us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945527.422491:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 270 00000100:00100000:1.0:1790945527.428600:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945527.428849:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254721280 00000100:00100000:0.0:1790945527.428860:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254721280 00000100:00100000:0.0:1790945527.428956:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 271 00000100:00100000:0.0:1790945527.428966:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:5615:x1877942254721280:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790945527.429255:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:5615:x1877942254721280:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 290us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945527.429262:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 271 00000100:00100000:0.0:1790945527.449763:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945527.450044:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254721408 00000100:00100000:2.0:1790945527.450054:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254721408 00000100:00100000:3.0:1790945527.450177:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 272 00000100:00100000:3.0:1790945527.450191:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:5615:x1877942254721408:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790945527.454024:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:5615:x1877942254721408:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 3826us (4261us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945527.454039:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 272 00000100:00100000:1.0:1790945527.463237:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945527.463415:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254721536 00000100:00100000:0.0:1790945527.463435:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254721536 00000100:00100000:0.0:1790945527.463495:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 273 00000100:00100000:0.0:1790945527.463626:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:9958:x1877942254721536:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790945527.463942:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:9958:x1877942254721536:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 437us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945527.463950:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 273 00000100:00100000:1.0:1790945527.479299:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945527.479749:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254721664 00000100:00100000:0.0:1790945527.479761:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254721664 00000100:00100000:0.0:1790945527.479813:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 274 00000100:00100000:0.0:1790945527.479825:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:9958:x1877942254721664:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790945527.480080:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:9958:x1877942254721664:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 257us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945527.480089:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 274 00010000:00010000:0.0:1790945527.516356:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790945528.220516:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790945528.541532:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945529.563919:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945529.628147:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273630336:0@lo:400:kworker.0 00000100:00100000:0.0:1790945529.628160:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273630208:0@lo:400:kworker.0 00000100:00100000:1.0:1790945529.628213:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273630592:0@lo:400:kworker.0 00000100:00100000:0.0:1790945529.644341:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945529.644421:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273630720:0@lo:400:kworker.0 00000100:00100000:0.0:1790945529.644459:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945529.644525:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273630464:0@lo:400:kworker.0 00000100:00100000:0.0:1790945529.644561:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945529.644588:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273630208 00000100:00100000:0.0:1790945529.644598:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273630720 00000100:00100000:3.0:1790945529.644599:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273630208 00000100:00100000:0.0:1790945529.644604:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273630720 00000100:00100000:0.0:1790945529.644651:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273630464 00000100:00100000:0.0:1790945529.644654:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273630464 00000100:00100000:3.0:1790945529.644680:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1790945529.644694:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273630208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945529.644695:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790945529.644706:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273630720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945529.644770:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273630208:12345-0@lo:400:kworker.0 Request processed in 81us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945529.644777:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:3.0:1790945529.644811:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945529.644840:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273630208:0@lo:400:kworker.0 00000100:00100000:3.0:1790945529.644887:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790945529.644895:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273630464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945529.644933:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273630464:12345-0@lo:400:kworker.0 Request processed in 38us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945529.644957:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790945529.645282:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273630720:12345-0@lo:400:kworker.0 Request processed in 577us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945529.645290:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790945529.645326:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273630464:0@lo:400:kworker.0 00000100:00100000:3.0:1790945529.646867:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273630720:0@lo:400:kworker.0 00000100:00100000:1.0:1790945529.648008:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945529.648171:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273630592 00000100:00100000:3.0:1790945529.648179:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273630592 00000100:00100000:3.0:1790945529.648243:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790945529.648253:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273630592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945529.648311:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273630592:12345-0@lo:400:kworker.0 Request processed in 59us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945529.648318:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1790945529.649604:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb873a11180 x1877942273630592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945529.649623:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273630592:0@lo:400:kworker.0 00000100:00080000:0.0:1790945529.649773:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945529.651893:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945529.651950:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273630848:0@lo:400:kworker.0 00000100:00100000:3.0:1790945529.651990:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945529.652234:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273630336 00000100:00100000:1.0:1790945529.652243:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273630336 00000100:00100000:1.0:1790945529.652295:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790945529.652306:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273630336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945529.652372:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273630336:12345-0@lo:400:kworker.0 Request processed in 68us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945529.652380:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790945529.652450:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273630848 00000100:00100000:2.0:1790945529.652455:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273630848 00000100:00100000:2.0:1790945529.652503:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790945529.652510:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273630848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945529.652546:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273630848:12345-0@lo:400:kworker.0 Request processed in 37us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945529.652551:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1790945529.652614:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790945529.652721:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273630336:0@lo:400:kworker.0 00000100:00100000:0.0:1790945529.652737:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1790945529.652742:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb88133f800, transno 4294967300 00000100:00100000:0.0:1790945529.652756:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273630848:0@lo:400:kworker.0 00000100:00100000:2.0:1790945530.140034:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273630976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945530.140158:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945530.140290:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273630976 00000100:00100000:0.0:1790945530.140298:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273630976 00000100:00100000:0.0:1790945530.140370:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790945530.140380:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273630976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945530.140417:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945530.140478:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273630976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945530.140487:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790945530.140537:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945530.140547:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273631104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945530.140788:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273630976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945530.142184:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945530.142240:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273631104 00000100:00100000:1.0:1790945530.142249:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273631104 00000100:00100000:1.0:1790945530.142296:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790945530.142306:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273631104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945530.142360:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945530.142428:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273631104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945530.142436:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1790945530.142465:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb873a11c00 x1877942273631104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945530.142483:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273631104:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1790945530.245822:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:0.0:1790945530.587891:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945531.545079:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945531.545133:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945531.545170:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945531.545206:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945531.545377:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254721920 00000100:00100000:2.0:1790945531.545388:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254721920 00000100:00100000:2.0:1790945531.545462:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254722176 00000100:00100000:2.0:1790945531.545466:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254722176 00000100:00100000:2.0:1790945531.545488:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 105 00000100:00100000:2.0:1790945531.545498:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254721920:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945531.545578:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254721920:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 81us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945531.545587:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 105 00000100:00100000:2.0:1790945531.545604:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 106 00000100:00100000:2.0:1790945531.545610:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254722176:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945531.545636:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254722176:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945531.545642:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 106 00000100:00100000:1.0:1790945531.546024:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254722048 00000100:00100000:1.0:1790945531.546029:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254722048 00000100:00100000:1.0:1790945531.546072:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 59 00000100:00100000:1.0:1790945531.546082:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254722048:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945531.546122:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254722048:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 42us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945531.546129:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 59 00000100:00080000:3.0:1790945531.547102:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945531.547109:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945531.548269:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254721792 00000100:00100000:0.0:1790945531.548282:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254721792 00000100:00100000:0.0:1790945531.548353:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 276 00000100:00100000:0.0:1790945531.548363:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254721792:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945531.548446:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254721792:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 84us (3377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945531.548452:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 276 00010000:00010000:0.0:1790945531.613155:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945532.639564:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945533.659891:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945534.683888:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945534.747890:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273631232:0@lo:400:kworker.0 00000100:00100000:0.0:1790945534.747982:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945534.748865:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945534.748923:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945534.748934:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273631488:0@lo:400:kworker.0 00000100:00100000:0.0:1790945534.748974:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945534.749009:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273631488 00000100:00100000:0.0:1790945534.749016:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273631488 00000100:00100000:0.0:1790945534.749084:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790945534.749094:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273631488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945534.749148:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273631488:12345-0@lo:400:kworker.0 Request processed in 56us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945534.749155:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1790945534.749176:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945534.749205:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273631488:0@lo:400:kworker.0 00000100:00100000:2.0:1790945534.755683:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273631232 00000100:00100000:2.0:1790945534.755698:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273631232 00000100:00100000:2.0:1790945534.755757:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1790945534.755767:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273631232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945534.755862:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273631232:12345-0@lo:400:kworker.0 Request processed in 95us (7879us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945534.755869:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1790945534.758636:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273631360:0@lo:400:kworker.0 00000100:00100000:1.0:1790945534.758728:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945534.758896:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273631232:0@lo:400:kworker.0 00000100:00100000:2.0:1790945534.759041:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273631360 00000100:00100000:2.0:1790945534.759088:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273631360 00000100:00100000:2.0:1790945534.759142:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790945534.759152:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273631360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945534.759226:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273631360:12345-0@lo:400:kworker.0 Request processed in 68us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945534.759234:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790945534.763585:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273631360:0@lo:400:kworker.0 00000100:00100000:3.0:1790945534.764703:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273631744:0@lo:400:kworker.0 00000100:00100000:3.0:1790945534.764784:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945534.764817:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945534.764823:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273631616:0@lo:400:kworker.0 00000100:00100000:3.0:1790945534.764849:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945534.764939:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273631872:0@lo:400:kworker.0 00000100:00100000:0.0:1790945534.764969:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945534.765014:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273631744 00000100:00100000:0.0:1790945534.765021:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273631744 00000100:00100000:0.0:1790945534.765085:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790945534.765093:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273631744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945534.765145:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273631744:12345-0@lo:400:kworker.0 Request processed in 53us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945534.765153:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1790945534.765175:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945534.765204:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273631744:0@lo:400:kworker.0 00000100:00100000:3.0:1790945534.765409:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273631616 00000100:00100000:3.0:1790945534.765415:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273631616 00000100:00100000:3.0:1790945534.765461:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273631872 00000100:00100000:3.0:1790945534.765464:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273631872 00000100:00100000:3.0:1790945534.765484:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790945534.765491:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273631616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945534.765529:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273631616:12345-0@lo:400:kworker.0 Request processed in 38us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945534.765535:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790945534.765549:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790945534.765555:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273631872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945534.765584:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273631872:12345-0@lo:400:kworker.0 Request processed in 30us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945534.765591:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1790945534.765646:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945534.765649:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945534.765698:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273631872:0@lo:400:kworker.0 00010000:00080000:0.0:1790945534.765725:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb873a12680 x1877942273631616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945534.765735:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273631616:0@lo:400:kworker.0 00000100:00100000:3.0:1790945535.260245:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273632000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945535.260329:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945535.260806:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273632128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945535.260839:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945535.261074:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273632000 00000100:00100000:1.0:1790945535.261082:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273632000 00000100:00100000:1.0:1790945535.261118:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273632128 00000100:00100000:1.0:1790945535.261121:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273632128 00000100:00100000:1.0:1790945535.261135:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790945535.261144:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273632000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790945535.261180:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945535.261238:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273632000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945535.261246:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790945535.261263:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790945535.261269:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273632128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945535.261290:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945535.261322:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273632128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945535.261329:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1790945535.261361:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb874acb480 x1877942273632128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945535.261378:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273632128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945535.261513:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273632000:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790945535.707907:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945536.661183:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945536.661230:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945536.661259:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945536.661306:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254722304 00000100:00100000:1.0:1790945536.661318:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254722304 00000100:00100000:3.0:1790945536.661331:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945536.661358:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254722560 00000100:00100000:3.0:1790945536.661377:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254722560 00000100:00100000:3.0:1790945536.661421:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:3.0:1790945536.661431:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254722560:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945536.661506:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254722560:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 77us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945536.661514:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:1.0:1790945536.661547:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 278 00000100:00100000:1.0:1790945536.661562:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254722304:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945536.661592:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254722304:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 32us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945536.661600:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 278 00000100:00100000:2.0:1790945536.662952:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254722432 00000100:00100000:2.0:1790945536.662961:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254722432 00000100:00100000:2.0:1790945536.663014:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254722688 00000100:00100000:2.0:1790945536.663017:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254722688 00000100:00100000:2.0:1790945536.663051:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 110 00000100:00100000:2.0:1790945536.663060:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2371:x1877942254722432:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945536.663123:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2371:x1877942254722432:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 64us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945536.663130:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 110 00000100:00100000:2.0:1790945536.663151:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 111 00000100:00100000:2.0:1790945536.663157:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254722688:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945536.663181:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254722688:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945536.663193:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 111 00000100:00080000:2.0:1790945536.663346:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945536.663352:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790945536.731893:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945537.756081:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790945538.460333:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790945538.780461:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945539.805477:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945539.871623:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273632640:0@lo:400:kworker.0 00000100:00100000:1.0:1790945539.871717:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945539.871790:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790945539.871797:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273632256:0@lo:400:kworker.0 00000100:00100000:1.0:1790945539.871826:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945539.871850:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273632768:0@lo:400:kworker.0 00000100:00100000:1.0:1790945539.871872:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945539.871899:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273632256 00000100:00100000:1.0:1790945539.871907:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273632256 00000100:00100000:1.0:1790945539.871949:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1790945539.871957:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273632256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945539.872005:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273632256:12345-0@lo:400:kworker.0 Request processed in 48us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945539.872024:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1790945539.872071:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273632256:0@lo:400:kworker.0 00000100:00100000:3.0:1790945539.872227:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273632384:0@lo:400:kworker.0 00000100:00100000:3.0:1790945539.872259:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945539.872289:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273632896:0@lo:400:kworker.0 00000100:00100000:3.0:1790945539.872341:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945539.872360:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945539.872365:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88133ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273632512:0@lo:400:kworker.0 00000100:00100000:3.0:1790945539.872386:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945539.872413:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273632768 00000100:00100000:3.0:1790945539.872417:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273632768 00000100:00100000:3.0:1790945539.872451:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273632384 00000100:00100000:3.0:1790945539.872454:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273632384 00000100:00100000:3.0:1790945539.872465:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273632512 00000100:00100000:3.0:1790945539.872467:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273632512 00000100:00100000:3.0:1790945539.872480:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790945539.872485:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273632768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945539.872522:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273632768:12345-0@lo:400:kworker.0 Request processed in 36us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945539.872528:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790945539.872542:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790945539.872548:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273632384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945539.872586:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273632384:12345-0@lo:400:kworker.0 Request processed in 38us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945539.872605:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790945539.872617:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790945539.872623:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273632512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945539.872651:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273632512:12345-0@lo:400:kworker.0 Request processed in 28us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945539.872680:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790945539.872709:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273632512:0@lo:400:kworker.0 00000100:00100000:3.0:1790945539.872719:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88133ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273632384:0@lo:400:kworker.0 00000100:00100000:3.0:1790945539.872739:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273632768:0@lo:400:kworker.0 00000100:00100000:2.0:1790945539.873129:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273632640 00000100:00100000:2.0:1790945539.873134:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273632640 00000100:00100000:2.0:1790945539.873171:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273632896 00000100:00100000:2.0:1790945539.873174:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273632896 00000100:00100000:2.0:1790945539.873201:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790945539.873217:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273632640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945539.873263:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273632640:12345-0@lo:400:kworker.0 Request processed in 47us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945539.873269:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790945539.873282:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790945539.873287:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273632896:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790945539.873450:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945539.873455:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790945539.873457:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945539.873512:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273632896:12345-0@lo:400:kworker.0 Request processed in 224us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945539.873518:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790945539.873579:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273632896:0@lo:400:kworker.0 00010000:00080000:3.0:1790945539.874349:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f8a300 x1877942273632640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945539.874361:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273632640:0@lo:400:kworker.0 00000100:00100000:1.0:1790945540.384917:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945540.384942:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273633024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945540.385063:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945540.385139:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273633024 00000100:00100000:1.0:1790945540.385146:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273633024 00000100:00100000:1.0:1790945540.385197:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790945540.385206:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273633024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790945540.385241:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945540.385287:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273633024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945540.385295:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790945540.385339:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273633024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945540.386526:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273633152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945540.386568:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945540.386689:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273633152 00000100:00100000:2.0:1790945540.386695:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273633152 00000100:00100000:2.0:1790945540.386724:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790945540.386732:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273633152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945540.386758:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945540.386798:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273633152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945540.386804:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1790945540.386833:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f89500 x1877942273633152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945540.386847:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273633152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790945540.828327:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945541.782475:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945541.782570:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945541.782974:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254722944 00000100:00100000:0.0:1790945541.782984:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254722944 00000100:00100000:0.0:1790945541.783068:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 115 00000100:00100000:0.0:1790945541.783077:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254722944:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945541.783150:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254722944:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 74us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945541.783157:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 115 00000100:00080000:1.0:1790945541.783221:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945541.784095:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254722816 00000100:00100000:2.0:1790945541.784102:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254722816 00000100:00100000:2.0:1790945541.784191:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 280 00000100:00100000:2.0:1790945541.784200:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254722816:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945541.784253:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254722816:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 54us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945541.784273:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 280 00000100:00100000:3.0:1790945541.792524:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945541.792573:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945541.793126:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254723200 00000100:00100000:1.0:1790945541.793142:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254723200 00000100:00100000:1.0:1790945541.793238:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 116 00000100:00100000:1.0:1790945541.793252:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254723200:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945541.793339:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254723200:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 92us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945541.793347:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 116 00000100:00080000:0.0:1790945541.793476:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945541.793981:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254723072 00000100:00100000:2.0:1790945541.793986:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254723072 00000100:00100000:2.0:1790945541.794086:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 19 00000100:00100000:2.0:1790945541.794094:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2369:x1877942254723072:12345-192.168.202.48@tcp:9:kworker.0 00000020:00000080:2.0:1790945541.794117:0:6672:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f384 00000100:00080000:2.0:1790945541.794125:0:6672:0:(import.c:65:import_set_state_nolock()) ffff9bb87390b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790945541.794172:0:6672:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1790945541.794398:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+2:2369:x1877942254723072:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 305us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945541.794405:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 19 00010000:00010000:3.0:1790945541.795463:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790945541.801097:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790945541.851845:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945542.875931:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945543.899931:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945544.924359:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945544.988532:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273633664:0@lo:400:kworker.0 00000100:00100000:3.0:1790945544.988606:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945544.988701:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790945544.988720:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273633280:0@lo:400:kworker.0 00000100:00100000:3.0:1790945544.988750:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945544.988775:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273633792:0@lo:400:kworker.0 00000100:00100000:3.0:1790945544.988797:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945544.988823:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273633280 00000100:00100000:3.0:1790945544.988831:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273633280 00000100:00100000:3.0:1790945544.988873:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1790945544.988881:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273633280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945544.988927:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273633280:12345-0@lo:400:kworker.0 Request processed in 46us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945544.988934:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1790945544.988995:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273633280:0@lo:400:kworker.0 00000100:00100000:1.0:1790945544.989096:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273633536:0@lo:400:kworker.0 00000100:00100000:1.0:1790945544.989242:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945544.989266:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790945544.989272:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273633408:0@lo:400:kworker.0 00000100:00100000:1.0:1790945544.989295:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945544.989317:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273633920:0@lo:400:kworker.0 00000100:00100000:1.0:1790945544.989339:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945544.989426:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273633792 00000100:00100000:0.0:1790945544.989430:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273633792 00000100:00100000:0.0:1790945544.989477:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273633536 00000100:00100000:0.0:1790945544.989480:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273633536 00000100:00100000:0.0:1790945544.989492:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273633408 00000100:00100000:0.0:1790945544.989494:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273633408 00000100:00100000:0.0:1790945544.989505:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790945544.989511:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273633792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945544.989549:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273633792:12345-0@lo:400:kworker.0 Request processed in 38us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945544.989556:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790945544.989568:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790945544.989574:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273633536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945544.989601:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273633536:12345-0@lo:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945544.989607:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790945544.989617:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790945544.989622:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273633408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945544.989645:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273633408:12345-0@lo:400:kworker.0 Request processed in 23us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945544.989650:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790945544.989734:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273633664 00000100:00100000:2.0:1790945544.989738:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273633664 00000100:00100000:2.0:1790945544.989772:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273633920 00000100:00100000:2.0:1790945544.989775:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273633920 00000100:00100000:2.0:1790945544.989795:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790945544.989802:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273633664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945544.989835:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273633664:12345-0@lo:400:kworker.0 Request processed in 34us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945544.989841:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790945544.989852:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790945544.989858:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273633920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945544.989881:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273633920:12345-0@lo:400:kworker.0 Request processed in 24us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945544.989887:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1790945544.990052:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790945544.990056:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790945544.990059:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945544.990084:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273633408:0@lo:400:kworker.0 00000100:00100000:1.0:1790945544.990093:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273633920:0@lo:400:kworker.0 00000100:00100000:1.0:1790945544.990114:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273633536:0@lo:400:kworker.0 00000100:00100000:3.0:1790945544.990340:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273633792:0@lo:400:kworker.0 00010000:00080000:3.0:1790945544.990352:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f88000 x1877942273633664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945544.990362:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273633664:0@lo:400:kworker.0 00000100:00100000:0.0:1790945545.500016:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945545.500040:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273634048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945545.500105:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945545.500216:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273634048 00000100:00100000:2.0:1790945545.500245:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273634048 00000100:00100000:2.0:1790945545.500315:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790945545.500325:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273634048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945545.500359:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945545.500414:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273634048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945545.500421:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1790945545.500762:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb865f8aa00 x1877942273634048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945545.500779:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273634048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945545.508266:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273634176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945545.508336:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945545.508928:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273634176 00000100:00100000:2.0:1790945545.508937:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273634176 00000100:00100000:2.0:1790945545.509003:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790945545.509012:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273634176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945545.509048:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945545.509171:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273634176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945545.509179:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790945545.513042:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273634176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790945545.954920:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790945546.153089:0:7627:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000020:00000080:0.0:1790945546.153100:0:7627:0:(genops.c:885:class_export_put()) final put ffff9bb87390d800/c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000020:00000080:2.0:1790945546.153167:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87390d800/c6be5708-366a-4e39-b76f-5dba2d1f1a3b for lustre-OST0001 00000020:00000080:2.0:1790945546.153233:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb87390b800 for lustre-OST0001 00000100:00100000:0.0:1790945546.915396:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945546.915437:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945546.915464:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945546.915863:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254723328 00000100:00100000:0.0:1790945546.915874:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254723328 00000100:00100000:0.0:1790945546.917320:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 282 00000100:00100000:0.0:1790945546.917338:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2371:x1877942254723328:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945546.917425:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2371:x1877942254723328:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 93us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945546.917434:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 282 00000100:00100000:0.0:1790945546.917487:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254723456 00000100:00100000:0.0:1790945546.917495:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254723456 00000100:00100000:1.0:1790945546.923311:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254723584 00000100:00100000:1.0:1790945546.923326:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254723584 00000100:00100000:0.0:1790945546.923568:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 120 00000100:00100000:0.0:1790945546.923580:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2371:x1877942254723456:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945546.923675:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2371:x1877942254723456:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 78us (8218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945546.923684:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 120 00000100:00100000:1.0:1790945546.926346:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 121 00000100:00100000:1.0:1790945546.926361:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254723584:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945546.927754:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254723584:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 84us (10977us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945546.927767:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 121 00000100:00080000:0.0:1790945546.927860:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790945546.976859:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945547.995838:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790945548.702053:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790945549.020124:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945550.047065:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790945550.083627:0:11835:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:52:28 (1790945548) 00000100:00100000:1.0:1790945550.117947:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb851953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273634304:0@lo:400:kworker.0 00000100:00100000:0.0:1790945550.117947:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb851950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273634688:0@lo:400:kworker.0 00000100:00100000:2.0:1790945550.120543:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb851952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273634432:0@lo:400:kworker.0 00000100:00100000:1.0:1790945550.131452:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945550.132358:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273634304 00000100:00100000:3.0:1790945550.132374:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273634304 00000100:00100000:3.0:1790945550.132458:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1790945550.132472:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273634304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945550.132644:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb851950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273634816:0@lo:400:kworker.0 00000100:00100000:1.0:1790945550.132724:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945550.132788:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb851953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273634560:0@lo:400:kworker.0 00000100:00100000:1.0:1790945550.132819:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945550.132875:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273634816 00000100:00100000:1.0:1790945550.132879:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273634816 00000100:00100000:1.0:1790945550.133088:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273634560 00000100:00100000:1.0:1790945550.133107:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273634560 00000100:00100000:1.0:1790945550.133134:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790945550.133140:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273634816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945550.133200:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273634816:12345-0@lo:400:kworker.0 Request processed in 59us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945550.133207:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790945550.133226:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790945550.133231:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273634560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945550.133261:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273634560:12345-0@lo:400:kworker.0 Request processed in 30us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945550.133267:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1790945550.133285:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945550.133329:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb851953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273634560:0@lo:400:kworker.0 00000100:00100000:1.0:1790945550.133362:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb851950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273634816:0@lo:400:kworker.0 00000100:00100000:3.0:1790945550.134083:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273634304:12345-0@lo:400:kworker.0 Request processed in 1610us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945550.135781:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb851953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273634304:0@lo:400:kworker.0 00000100:00100000:3.0:1790945550.135898:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1790945550.138697:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945550.138779:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273634432 00000100:00100000:3.0:1790945550.138791:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273634432 00000100:00100000:3.0:1790945550.138856:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790945550.138869:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273634432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945550.138960:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273634432:12345-0@lo:400:kworker.0 Request processed in 94us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945550.138968:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790945550.139597:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb851952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273634432:0@lo:400:kworker.0 00000100:00100000:3.0:1790945550.139741:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb851952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273634944:0@lo:400:kworker.0 00000100:00100000:3.0:1790945550.139793:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945550.139826:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273634944 00000100:00100000:3.0:1790945550.139833:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273634944 00000100:00100000:3.0:1790945550.139883:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790945550.139890:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273634944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945550.139945:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273634944:12345-0@lo:400:kworker.0 Request processed in 55us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945550.139952:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1790945550.139976:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945550.140003:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb851952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273634944:0@lo:400:kworker.0 00000100:00100000:0.0:1790945550.148484:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945550.150007:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273634688 00000100:00100000:0.0:1790945550.150025:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273634688 00000100:00100000:0.0:1790945550.150121:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790945550.150153:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273634688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945550.150257:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273634688:12345-0@lo:400:kworker.0 Request processed in 108us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945550.150265:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1790945550.159854:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb851950700 x1877942273634688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790945566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945550.159878:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb851950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273634688:0@lo:400:kworker.0 00000100:00080000:0.0:1790945550.160839:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945550.619983:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273635072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945550.620088:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945550.622694:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273635072 00000100:00100000:0.0:1790945550.622716:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273635072 00000100:00100000:0.0:1790945550.622789:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790945550.622802:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273635072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790945550.622851:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945550.622967:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273635072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (2879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945550.622975:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790945550.624535:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273635200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945550.624640:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790945550.624814:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb874ac8e00 x1877942273635072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945550.624842:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273635072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945550.625251:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273635200 00000100:00100000:2.0:1790945550.625262:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273635200 00000100:00100000:2.0:1790945550.625323:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790945550.625335:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273635200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945550.625381:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945550.625455:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273635200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945550.625463:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790945550.626616:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273635200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790945551.067961:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945552.029791:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945552.029841:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945552.029879:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945552.030004:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254723968 00000100:00100000:1.0:1790945552.030019:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254723968 00000100:00100000:1.0:1790945552.030101:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254723840 00000100:00100000:1.0:1790945552.030104:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254723840 00000100:00100000:1.0:1790945552.030129:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 125 00000100:00100000:1.0:1790945552.030140:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2373:x1877942254723968:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945552.030249:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2373:x1877942254723968:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 110us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945552.030257:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 125 00000100:00100000:1.0:1790945552.030277:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 126 00000100:00100000:1.0:1790945552.030298:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2373:x1877942254723840:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945552.030328:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2373:x1877942254723840:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 44us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945552.030334:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 126 00000100:00080000:2.0:1790945552.030690:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945552.031729:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254723712 00000100:00100000:3.0:1790945552.031744:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254723712 00000100:00100000:3.0:1790945552.031842:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 284 00000100:00100000:3.0:1790945552.031853:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2373:x1877942254723712:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945552.031957:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2373:x1877942254723712:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 105us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945552.031965:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 284 00010000:00010000:1.0:1790945552.098428:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945552.419408:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945552.424320:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254724096 00000100:00100000:1.0:1790945552.424343:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254724096 00000100:00100000:1.0:1790945552.424452:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 32 00000100:00100000:1.0:1790945552.424466:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:10227:x1877942254724096:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945552.424513:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945552.424546:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f44f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c813e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945552.424653:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f456 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945552.424720:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945552.424737:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945552.424786:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790945552.424790:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790945552.424842:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945552.424885:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f44f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c813e expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945552.424918:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f456 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c813e expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945552.424930:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb843765700) 00010000:00010000:1.0:1790945552.424933:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790945552.424937:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133400, rc 0) 00000100:00100000:1.0:1790945552.425281:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:10227:x1877942254724096:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 816us (5879us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945552.425288:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 32 00000100:00100000:2.0:1790945552.450341:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945552.450500:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254724224 00000100:00100000:3.0:1790945552.450513:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254724224 00000100:00100000:3.0:1790945552.450581:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00100000:3.0:1790945552.450591:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:10228:x1877942254724224:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945552.450617:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945552.450642:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f45d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8145 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.450756:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f464 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.450772:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f464 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.450793:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f464 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.450809:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f46b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.450816:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f46b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.450823:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f46b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451061:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5800/0xc5cf2c2a6a54f472 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451083:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5800/0xc5cf2c2a6a54f472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451091:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5800/0xc5cf2c2a6a54f472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945552.451120:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790945552.451124:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790945552.451146:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5800/0xc5cf2c2a6a54f472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451157:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f464 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451164:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f464 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451170:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f464 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451176:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945552.451180:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f464 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451188:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f464 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451200:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb843765700) 00010000:00010000:3.0:1790945552.451209:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945552.451214:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f464 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451221:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f464 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451236:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f46b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451242:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f46b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451248:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f46b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451253:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945552.451256:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f46b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451262:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f46b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451270:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bb851c9af00) 00010000:00010000:3.0:1790945552.451273:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945552.451276:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f46b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451281:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f46b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451314:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f45d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8145 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451339:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5800/0xc5cf2c2a6a54f472 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8145 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.451358:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bb851c9ab00) 00010000:00010000:3.0:1790945552.451362:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945552.451365:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c5800, rc 0) 00000100:00100000:3.0:1790945552.451434:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:10228:x1877942254724224:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 844us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945552.451443:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00100000:0.0:1790945552.465187:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945552.465324:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254724480 00000100:00100000:3.0:1790945552.465340:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254724480 00000100:00100000:3.0:1790945552.465420:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 34 00000100:00100000:3.0:1790945552.465431:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:10228:x1877942254724480:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945552.465460:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945552.465487:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f479 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c814c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.465606:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f480 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.465625:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f480 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.465648:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f480 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.465943:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f487 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.465979:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f487 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.465991:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f487 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466436:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5000/0xc5cf2c2a6a54f48e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466447:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5000/0xc5cf2c2a6a54f48e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466454:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5000/0xc5cf2c2a6a54f48e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945552.466466:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790945552.466852:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f480 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466860:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f480 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466868:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f480 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466874:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945552.466879:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f480 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466886:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f480 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466922:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bb851c9ab00) 00010000:00010000:3.0:1790945552.466926:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945552.466930:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f480 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466937:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f480 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466953:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f487 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466959:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f487 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466965:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f487 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466970:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945552.466973:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f487 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466979:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f487 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466986:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bb851c9af00) 00010000:00010000:3.0:1790945552.466989:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945552.466991:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f487 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.466996:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f487 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.468640:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f479 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c814c expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.468688:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5000/0xc5cf2c2a6a54f48e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c814c expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945552.468697:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a900) 00010000:00010000:3.0:1790945552.468699:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945552.468703:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c5000, rc 0) 00000100:00100000:3.0:1790945552.468780:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:10228:x1877942254724480:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 3349us (3609us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790945552.468788:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 34 00000100:00100000:2.0:1790945552.485601:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945552.485869:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254724608 00000100:00100000:0.0:1790945552.485881:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254724608 00000100:00100000:0.0:1790945552.485959:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 35 00000100:00100000:0.0:1790945552.485970:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:10228:x1877942254724608:12345-192.168.202.48@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790945552.486303:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:10228:x1877942254724608:12345-192.168.202.48@tcp:59:lhsmtool_posix.0 Request processed in 334us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945552.486487:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 35 00000040:00080000:2.0:1790945552.796485:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790945553.118337:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945554.140592:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945554.839953:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945554.840110:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254724736 00000100:00100000:1.0:1790945554.840141:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254724736 00000100:00100000:1.0:1790945554.840227:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00100000:1.0:1790945554.840240:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:10270:x1877942254724736:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1790945554.840268:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945554.840295:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f49c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8153 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840386:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f4a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840406:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f4a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840424:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f4a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840442:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f4aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840451:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f4aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840458:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f4aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840742:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f4a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840752:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f4a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840761:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f4a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840773:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945554.840778:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f4a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840787:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f4a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840801:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb843765700) 00010000:00010000:1.0:1790945554.840805:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945554.840811:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f4a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840817:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f4a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840831:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f4aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840837:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f4aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840843:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f4aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840848:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945554.840851:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f4aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840857:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f4aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840895:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bb843765a00) 00010000:00010000:1.0:1790945554.840898:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945554.840901:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f4aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840907:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f4aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840954:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f49c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8153 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840965:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb843765700) 00010000:00010000:1.0:1790945554.840968:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945554.840972:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f49c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8153 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945554.840982:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133e00, rc 0) 00000100:00100000:1.0:1790945554.841064:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:10270:x1877942254724736:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 827us (1125us total) trans 0 rc 301/301 00000100:00100000:1.0:1790945554.841072:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00080000:0.0:1790945554.841430:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945554.849759:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945554.849840:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254724992 00000100:00100000:3.0:1790945554.849855:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254724992 00000100:00100000:3.0:1790945554.849943:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 37 00000100:00100000:3.0:1790945554.849956:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:10270:x1877942254724992:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:3.0:1790945554.850036:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945554.850277:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f456 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c813e expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.850303:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb843765700) 00010000:00010000:3.0:1790945554.850323:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945554.851594:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.851634:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.851649:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.851687:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f4b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.851695:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f4b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.851703:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f4b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945554.854784:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790945554.854809:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.854821:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.854831:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.854838:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945554.854844:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.854854:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.854902:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb851c9a100) 00010000:00010000:3.0:1790945554.854905:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945554.854913:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.854920:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790945554.854950:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bfdcb61b reply state 0000000029dcc5c9 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f4b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945554.854962:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945554.855140:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:10270:x1877942254724992:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 5179us (5388us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790945554.855151:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 37 00010000:00010000:3.0:1790945554.858913:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f4b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.858937:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f4b8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.858946:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f4b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.858953:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945554.858958:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f4b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.858967:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f4b8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.859001:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bb851c9a400) 00010000:00010000:3.0:1790945554.859005:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945554.859010:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f4b8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945554.859017:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f4b8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945555.027584:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945555.027761:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254725120 00000100:00100000:2.0:1790945555.027775:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254725120 00000100:00100000:2.0:1790945555.027857:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 38 00000100:00100000:2.0:1790945555.027878:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:10278:x1877942254725120:12345-192.168.202.48@tcp:101:lctl.0 00010000:00010000:2.0:1790945555.027912:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945555.027944:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f4bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c815a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.028035:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54f4c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.028052:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54f4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.028068:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54f4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945555.028125:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790945555.028130:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945555.028186:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54f4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.028226:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f4bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c815a expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.028267:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54f4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c815a expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.028277:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb845042600) 00010000:00010000:2.0:1790945555.028281:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945555.028285:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434aee00, rc 0) 00000100:00100000:2.0:1790945555.028378:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:10278:x1877942254725120:12345-192.168.202.48@tcp:101:lctl.0 Request processed in 510us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945555.028387:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 38 00000100:00100000:1.0:1790945555.116261:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945555.116475:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254725248 00000100:00100000:0.0:1790945555.116490:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254725248 00000100:00100000:0.0:1790945555.116623:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 39 00000100:00100000:0.0:1790945555.116637:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:10284:x1877942254725248:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1790945555.116726:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945555.116752:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f4cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8161 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.116835:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f4d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.116854:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.116878:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.116897:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f4db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.116905:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f4db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.116913:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f4db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117036:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a54f4e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117045:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a54f4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117052:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a54f4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945555.117086:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790945555.117096:0:7211:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945555.117149:0:7211:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a54f4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117163:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117170:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f4d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117177:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117183:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945555.117189:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117197:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f4d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117223:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb845042600) 00010000:00010000:0.0:1790945555.117227:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945555.117234:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f4d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117240:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f4d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117257:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f4db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117264:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f4db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117279:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f4db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117284:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945555.117287:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f4db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117293:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f4db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117301:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bb8510c8900) 00010000:00010000:0.0:1790945555.117303:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945555.117306:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f4db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117310:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f4db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117345:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f4cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8161 expref: 12 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.117358:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a54f4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8161 expref: 11 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.118722:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:0.0:1790945555.118726:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790945555.118729:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1de00, rc 0) 00000100:00100000:0.0:1790945555.118852:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:10284:x1877942254725248:12345-192.168.202.48@tcp:101:bash.0 Request processed in 2214us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945555.118889:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 39 00000100:00100000:1.0:1790945555.122178:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945555.122387:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254725504 00000100:00100000:3.0:1790945555.122401:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254725504 00000100:00100000:3.0:1790945555.122485:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 40 00000100:00100000:3.0:1790945555.122498:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:10284:x1877942254725504:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:3.0:1790945555.122529:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945555.122556:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f4e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8168 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.122777:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.122795:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.122808:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.122989:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f4f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.123015:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f4f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.123108:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f4f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790945555.136774:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1790945555.137745:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f4fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.137766:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f4fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.137779:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f4fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.137820:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.137828:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.137834:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.137840:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945555.137845:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.137853:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.137876:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:3.0:1790945555.137880:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945555.137893:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.137901:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f4f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790945555.142729:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000668eb842 reply state 00000000fbef6aab transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f4f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945555.142749:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790945555.142810:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f4e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8168 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.142830:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f4fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8168 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.142839:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb851c9a400) 00010000:00010000:3.0:1790945555.142842:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945555.142845:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4000, rc 0) 00000100:00100000:3.0:1790945555.142961:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:10284:x1877942254725504:12345-192.168.202.48@tcp:101:bash.0 Request processed in 20466us (20796us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1790945555.142970:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 40 00010000:00010000:3.0:1790945555.146702:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f4f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.146722:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f4f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.146730:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f4f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.146755:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945555.146760:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f4f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.146767:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f4f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.146783:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb851c9af00) 00010000:00010000:3.0:1790945555.146786:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945555.146791:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f4f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.146797:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f4f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945555.153167:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945555.153438:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254725632 00000100:00100000:3.0:1790945555.153448:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254725632 00000100:00100000:3.0:1790945555.153494:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 20 00000100:00100000:3.0:1790945555.153503:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2369:x1877942254725632:12345-192.168.202.48@tcp:8:bash.0 00010000:00080000:3.0:1790945555.153533:0:6670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:3.0:1790945555.153562:0:6670:0:(genops.c:1384:class_connect()) connect: client c6be5708-366a-4e39-b76f-5dba2d1f1a3b, cookie 0xc5cf2c2a6a54f50c 00002000:00100000:3.0:1790945555.153574:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c6be5708-366a-4e39-b76f-5dba2d1f1a3b/ffff9bb860238800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790945555.153607:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790945555.153907:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790945555.155809:0:6670:0:(import.c:65:import_set_state_nolock()) ffff9bb87b4bd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790945555.155904:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2369:x1877942254725632:12345-192.168.202.48@tcp:8:bash.0 Request processed in 2397us (2741us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945555.155985:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 20 00000100:00100000:1.0:1790945555.159475:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945555.160313:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254725760 00000100:00100000:0.0:1790945555.160323:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254725760 00000100:00100000:0.0:1790945555.160404:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 21 00000100:00100000:0.0:1790945555.160415:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:0:x1877942254725760:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1790945555.160433:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945555.160456:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54f513 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c816f expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790945555.160481:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790945555.160500:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:0.0:1790945555.160505:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945555.160515:0:6672:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54f513 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c816f expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.160533:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54f513 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c816f expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.160546:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c400, rc 0) 00000100:00080000:2.0:1790945555.160676:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945555.161226:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:0:x1877942254725760:12345-192.168.202.48@tcp:101:bash.0 Request processed in 811us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945555.161253:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 21 00010000:00010000:3.0:1790945555.169788:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945555.172142:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945555.172619:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254725888 00000100:00100000:2.0:1790945555.172631:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254725888 00000100:00100000:2.0:1790945555.172759:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 22 00000100:00100000:2.0:1790945555.172770:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:10284:x1877942254725888:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:2.0:1790945555.172790:0:7919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945555.172811:0:7919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8176 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.172844:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54f513 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c816f expref: 8 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.172853:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945555.172858:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945555.172863:0:7919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 8 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.172934:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54f513 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c816f expref: 8 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.172950:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54f513 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c816f expref: 8 pid: 6672 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945555.172965:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7919:1877942273635328:192.168.202.48@tcp:104: 00000100:00100000:2.0:1790945555.173069:0:7919:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945555.177462:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945555.177501:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254726016 00000100:00100000:1.0:1790945555.177511:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254726016 00010000:00010000:1.0:1790945555.177552:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54f513 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c816f expref: 9 pid: 6672 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945555.177589:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 35 00000100:00100000:1.0:1790945555.177599:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2373:x1877942254726016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945555.177615:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945555.177637:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54f513 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c816f expref: 9 pid: 6672 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945555.177652:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54f513 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c816f expref: 9 pid: 6672 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945555.177696:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945555.177700:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945555.177710:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 9 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945555.177720:0:8440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 9 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945555.177760:0:8440:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 9 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945555.177775:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8814aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8440:1877942273635456:192.168.202.48@tcp:105: 00000100:00100000:1.0:1790945555.177863:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b34ef00 going to sleep for 11 seconds 00010000:00010000:3.0:1790945555.178075:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54f513 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c816f expref: 9 pid: 6672 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945555.178115:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7919:1877942273635328:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945555.178140:0:7919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 8 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.178151:0:7919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434af600, rc 0) 00000100:00100000:3.0:1790945555.178203:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:10284:x1877942254725888:12345-192.168.202.48@tcp:101:bash.0 Request processed in 5425us (6059us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945555.178211:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 22 00000100:00100000:1.0:1790945555.192297:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945555.192384:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8814aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8440:1877942273635456:192.168.202.48@tcp:105: 00010000:00010000:3.0:1790945555.192409:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945555.192460:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2373:x1877942254726016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 14863us (15008us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945555.192470:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 35 00000100:00100000:0.0:1790945555.192802:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254726272 00000100:00100000:0.0:1790945555.192809:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254726272 00000100:00100000:0.0:1790945555.192854:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:0.0:1790945555.192862:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:10284:x1877942254726272:12345-192.168.202.48@tcp:35:bash.0 00000100:00100000:0.0:1790945555.193189:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:10284:x1877942254726272:12345-192.168.202.48@tcp:35:bash.0 Request processed in 327us (901us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1790945555.193196:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:1.0:1790945555.228456:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8814aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273635840:0@lo:400:kworker.0 00000100:00100000:1.0:1790945555.228526:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945555.228562:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790945555.228568:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8814ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273635712:0@lo:400:kworker.0 00000100:00100000:1.0:1790945555.228588:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945555.228605:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8814ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273636224:0@lo:400:kworker.0 00000100:00100000:1.0:1790945555.228632:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945555.228690:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273636224 00000100:00100000:1.0:1790945555.228698:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273636224 00000100:00100000:1.0:1790945555.228756:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790945555.228766:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273636224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945555.228816:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273636224:12345-0@lo:400:kworker.0 Request processed in 52us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945555.228823:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1790945555.228842:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945555.228852:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273635840 00000100:00100000:1.0:1790945555.228855:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273635840 00000100:00100000:1.0:1790945555.228889:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273635712 00000100:00100000:1.0:1790945555.228892:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273635712 00000100:00100000:1.0:1790945555.228906:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790945555.228912:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273635840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945555.228950:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273635840:12345-0@lo:400:kworker.0 Request processed in 38us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945555.228956:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790945555.228966:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790945555.228984:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273635712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945555.229007:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273635712:12345-0@lo:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945555.229012:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1790945555.229024:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945555.229050:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8814ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273635712:0@lo:400:kworker.0 00000100:00100000:1.0:1790945555.229062:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8814ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273636224:0@lo:400:kworker.0 00000100:00100000:1.0:1790945555.229070:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8814aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273635840:0@lo:400:kworker.0 00000100:00100000:0.0:1790945555.230055:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8814af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273635968:0@lo:400:kworker.0 00000100:00100000:0.0:1790945555.230119:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945555.230150:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790945555.230156:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8814ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273635584:0@lo:400:kworker.0 00000100:00100000:0.0:1790945555.230187:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945555.230234:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8814afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273636096:0@lo:400:kworker.0 00000100:00100000:0.0:1790945555.230260:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945555.230302:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273636096 00000100:00100000:0.0:1790945555.230308:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273636096 00000100:00100000:0.0:1790945555.230350:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790945555.230358:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273636096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945555.230403:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273636096:12345-0@lo:400:kworker.0 Request processed in 45us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945555.230410:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1790945555.230428:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945555.230449:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8814afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273636096:0@lo:400:kworker.0 00000100:00100000:3.0:1790945555.230707:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273635584 00000100:00100000:3.0:1790945555.230713:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273635584 00000100:00100000:3.0:1790945555.230752:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1790945555.230759:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273635584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945555.230798:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273635584:12345-0@lo:400:kworker.0 Request processed in 40us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945555.230803:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1790945555.234076:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8814ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273635584:0@lo:400:kworker.0 00000100:00100000:1.0:1790945555.235249:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273635968 00000100:00100000:1.0:1790945555.235260:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273635968 00000100:00100000:1.0:1790945555.235339:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790945555.235348:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273635968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945555.235447:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273635968:12345-0@lo:400:kworker.0 Request processed in 100us (5328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945555.235455:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790945555.235694:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8814af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273635968:0@lo:400:kworker.0 00000100:00080000:0.0:1790945555.240127:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790945555.333138:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945555.333267:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254726528 00000100:00100000:3.0:1790945555.333277:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254726528 00000100:00100000:3.0:1790945555.333333:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 41 00000100:00100000:3.0:1790945555.333343:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:10294:x1877942254726528:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945555.333384:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945555.333404:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f521 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c817d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945555.333488:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790945555.333590:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f521 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c817d expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.333604:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb845042600) 00010000:00010000:3.0:1790945555.333608:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945555.333612:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c817d expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.333626:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4200, rc 0) 00000100:00100000:3.0:1790945555.333728:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:10294:x1877942254726528:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 386us (599us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1790945555.333735:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 41 00000100:00100000:1.0:1790945555.339354:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945555.339451:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254726784 00000100:00100000:0.0:1790945555.339463:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254726784 00000100:00100000:0.0:1790945555.339520:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:0.0:1790945555.339530:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:10294:x1877942254726784:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1790945555.339811:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:10294:x1877942254726784:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 282us (465us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1790945555.339819:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:1.0:1790945555.442928:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945555.443027:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254726912 00000100:00100000:2.0:1790945555.443112:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254726912 00000100:00100000:2.0:1790945555.443179:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 42 00000100:00100000:2.0:1790945555.443189:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:10300:x1877942254726912:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945555.443292:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945555.443313:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f52f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8184 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.443380:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f536 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.443394:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.443407:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945555.443458:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790945555.443462:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945555.443483:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.443509:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f52f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8184 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.443529:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8184 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.443538:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:2.0:1790945555.443541:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945555.443545:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434aea00, rc 0) 00000100:00100000:2.0:1790945555.444465:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+17:10300:x1877942254726912:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1273us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945555.444473:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 42 00000100:00100000:1.0:1790945555.455922:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945555.456160:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254727168 00000100:00100000:3.0:1790945555.456170:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254727168 00000100:00100000:3.0:1790945555.456280:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 43 00000100:00100000:3.0:1790945555.456299:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+17:10300:x1877942254727168:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945555.456321:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945555.456341:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f53d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c818b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.456436:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f544 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.456470:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.456482:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945555.456495:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790945555.456623:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f53d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c818b expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.456643:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f544 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c818b expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.456653:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb851c9a400) 00010000:00010000:3.0:1790945555.456705:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945555.456710:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4600, rc 0) 00000100:00100000:3.0:1790945555.456914:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:10300:x1877942254727168:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 615us (1000us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1790945555.456921:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 43 00000100:00100000:1.0:1790945555.468038:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945555.468119:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945555.468193:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254727552 00000100:00100000:3.0:1790945555.468205:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254727552 00000100:00100000:3.0:1790945555.468270:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:3.0:1790945555.468280:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:2372:x1877942254727552:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945555.468297:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945555.468321:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f544 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c818b expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.468355:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb851c9a400) 00010000:00010000:3.0:1790945555.468360:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945555.468412:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+18:2372:x1877942254727552:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 133us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945555.468420:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:0.0:1790945555.468559:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254727424 00000100:00100000:0.0:1790945555.468564:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254727424 00000100:00100000:0.0:1790945555.468602:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 44 00000100:00100000:0.0:1790945555.468610:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+18:10300:x1877942254727424:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945555.468629:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945555.468643:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f552 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8192 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.468747:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f559 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.468760:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f559 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.468770:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f559 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945555.468780:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790945555.468907:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f552 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8192 expref: 21 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.468935:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f559 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8192 expref: 20 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.468943:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb851c9a400) 00010000:00010000:0.0:1790945555.468946:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790945555.468948:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d800, rc 0) 00000100:00100000:0.0:1790945555.468974:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:10300:x1877942254727424:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 365us (855us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1790945555.468981:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 44 00000100:00100000:2.0:1790945555.479926:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945555.480025:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254727680 00000100:00100000:1.0:1790945555.480035:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254727680 00000100:00100000:2.0:1790945555.480178:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 23 00000100:00100000:2.0:1790945555.480191:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2373:x1877942254727680:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1790945555.480235:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.480255:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 7 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.480281:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1790945555.480296:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945555.480300:0:6672:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.480335:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 7 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.480349:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 7 pid: 7919 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945555.480364:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1877942273636352:192.168.202.48@tcp:104: 00000100:00100000:2.0:1790945555.480456:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc6180 going to sleep for 11 seconds 00000100:00100000:1.0:1790945555.488393:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945555.488950:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254727808 00000100:00100000:0.0:1790945555.488961:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254727808 00002000:00100000:0.0:1790945555.489007:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9bb88165fb80 x1877942254727808/t0(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:251/0 lens 504/0 e 0 to 0 dl 1790945566 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790945555.489018:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb88165fb80 with x1877942254727808 ext(0->12) 00010000:00010000:0.0:1790945555.489029:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 8 pid: 7919 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.489046:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 8 pid: 7919 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790945555.489065:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bb88165fb80 00000100:00100000:0.0:1790945555.489110:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:0.0:1790945555.489119:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2372:x1877942254727808:12345-192.168.202.48@tcp:4:lfs.0 00000100:00100000:2.0:1790945555.498367:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1877942273636352:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945555.498403:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1790945555.528346:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000100:00100000:2.0:1790945555.606897:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2372:x1877942254727808:12345-192.168.202.48@tcp:4:lfs.0 Request processed in 117768us (118502us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790945555.606917:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 0 00002000:00100000:2.0:1790945555.606933:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9bb88165fb80 x1877942254727808/t4294967299(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:251/0 lens 504/448 e 0 to 0 dl 1790945566 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790945555.606944:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb88165fb80 with x1877942254727808 ext(0->12) 00010000:00010000:2.0:1790945555.606964:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 9 pid: 7919 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.606982:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 9 pid: 7919 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790945555.606990:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bb88165fb80 00000001:00080000:2.0:1790945555.607034:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1790945555.611811:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945555.612095:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254727936 00000100:00100000:1.0:1790945555.612106:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254727936 00010000:00010000:1.0:1790945555.612156:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 7 pid: 7919 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945555.612201:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00100000:1.0:1790945555.612211:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2371:x1877942254727936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945555.612226:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790945555.612245:0:5809:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790945555.612248:0:5809:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790945555 00002000:00010000:1.0:1790945555.612250:0:5809:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790945555 00002000:00010000:1.0:1790945555.612252:0:5809:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790945555 00002000:00010000:1.0:1790945555.612254:0:5809:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1790945555.612260:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 7 pid: 7919 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945555.612274:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 7 pid: 7919 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945555.612315:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006655ec34/0xc5cf2c2a6a54f51a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8176 expref: 7 pid: 7919 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945555.612335:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790945555.612339:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790945555.612345:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945555.612354:0:5809:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945555.612401:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945555.612469:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254727936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 259us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945555.612477:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 36 00010000:00010000:2.0:1790945555.613247:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.613261:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.613300:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.613312:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.613320:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.613327:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434ae000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945555.613332:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.613355:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.613371:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.613379:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c3baed6/0xc5cf2c2a6a54f567 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945555.613455:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2373:x1877942254727680:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 133266us (133535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945555.613463:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 23 00000100:00100000:3.0:1790945555.620806:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945555.620909:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254728192 00000100:00100000:0.0:1790945555.620933:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254728192 00000100:00100000:0.0:1790945555.620986:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:0.0:1790945555.620996:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:10300:x1877942254728192:12345-192.168.202.48@tcp:35:lfs.0 00000004:00010000:0.0:1790945555.621069:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f559 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8192 expref: 20 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790945555.621363:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1790945555.621418:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1790945555.621973:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1790945555.622025:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.622042:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f4fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8168 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.622052:0:5826:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.622085:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f4fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8168 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.622100:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f4fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8168 expref: 24 pid: 5824 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945555.622115:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5826:1877942273636480:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945555.622199:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48780 going to sleep for 11 seconds 00000100:00100000:0.0:1790945555.625355:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945555.625471:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254728320 00000100:00100000:3.0:1790945555.625481:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254728320 00010000:00010000:3.0:1790945555.625520:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f4fe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8168 expref: 25 pid: 5824 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945555.625561:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 37 00000100:00100000:3.0:1790945555.625571:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:2372:x1877942254728320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945555.625586:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945555.625592:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f4fe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8168 expref: 25 pid: 5824 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.625606:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f4fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8168 expref: 25 pid: 5824 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.625627:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb851c9a400) 00010000:00010000:3.0:1790945555.625632:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.625732:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.625740:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.625759:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945555.625806:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:2372:x1877942254728320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 236us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945555.625814:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 37 00010000:00010000:2.0:1790945555.627947:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a54f4fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8168 expref: 24 pid: 5824 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945555.627973:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5826:1877942273636480:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945555.627997:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.628008:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.628013:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945555.628138:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1790945555.628941:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1790945555.629076:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877942273636608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790945555.629137:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945555.629180:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945555.629343:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273636608 00000100:00100000:3.0:1790945555.629351:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273636608 00000100:00100000:3.0:1790945555.629398:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790945555.629408:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1877942273636608:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790945555.629543:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1877942273636608:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 134us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945555.629550:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790945555.630401:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877942273636608:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790945555.631083:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1790945555.631157:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877942273636736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790945555.631215:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945555.631249:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48780 going to sleep for 11 seconds 00000100:00100000:3.0:1790945555.631486:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273636736 00000100:00100000:3.0:1790945555.631492:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273636736 00000100:00100000:3.0:1790945555.631540:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945555.631549:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1877942273636736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790945555.631798:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5826:x1877942273636736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 250us (582us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790945555.631806:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790945555.631968:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877942273636736:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790945555.632016:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1790945555.632053:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.632062:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.632070:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.632075:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945555.632079:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.632086:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.632100:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb851c9a400) 00010000:00010000:0.0:1790945555.632103:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790945555.632107:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.632113:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f56e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790945555.632274:0:5826:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790945555.632596:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1790945555.632611:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 301427953269ns, next at 302427948159ns, rc = 0 00000001:00080000:0.0:1790945555.632618:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1790945555.632649:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb851c9a400) 00010000:00010000:0.0:1790945555.632652:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790945555.632929:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f559 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8192 expref: 28 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945555.633042:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:10300:x1877942254728192:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 12046us (12244us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1790945555.633050:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8 00000020:00080000:0.0:1790945555.633055:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790945555.649944:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945555.650062:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254728448 00000100:00100000:0.0:1790945555.650073:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254728448 00000100:00100000:0.0:1790945555.650134:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 45 00000100:00100000:0.0:1790945555.650145:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:10300:x1877942254728448:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945555.650169:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945555.650201:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f575 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8199 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.650264:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f575 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8199 expref: 28 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.650279:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f575 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8199 expref: 28 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.650314:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:0.0:1790945555.650317:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790945555.650333:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d800, rc 0) 00000100:00100000:0.0:1790945555.650703:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+28:10300:x1877942254728448:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 558us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945555.650710:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 45 00000100:00100000:3.0:1790945555.669514:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945555.671406:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254728704 00000100:00100000:2.0:1790945555.671423:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254728704 00000100:00100000:2.0:1790945555.672590:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:2.0:1790945555.672608:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8477f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+28:10300:x1877942254728704:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1790945555.674551:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8477f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:10300:x1877942254728704:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 1940us (5040us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1790945555.674565:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:3.0:1790945555.740529:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88165d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273636864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945555.740620:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945555.740774:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273636864 00000100:00100000:1.0:1790945555.740784:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273636864 00000100:00100000:1.0:1790945555.740827:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790945555.740835:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273636864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945555.740857:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1790945555.740924:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273636864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945555.740932:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790945555.742049:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88165d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273636864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945555.742129:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273636992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945555.742174:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945555.742232:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273636992 00000100:00100000:2.0:1790945555.742238:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273636992 00000100:00100000:2.0:1790945555.742268:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790945555.742274:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273636992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945555.742300:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945555.742792:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273636992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 516us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945555.742799:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790945555.744033:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273636992:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1790945555.789827:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967325 is committed 00000004:00080000:0.0:1790945555.789843:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1790945555.789878:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb865d48d80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1790945555.789883:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb865c45c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb865d48b40 00000020:00080000:0.0:1790945555.789886:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb865c45800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb86c973000 00000001:00080000:0.0:1790945555.789933:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000020:00080000:0.0:1790945555.789960:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1790945555.790343:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1790945555.790556:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790945555.790578:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8814ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273637120:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790945555.790652:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945555.790797:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273637120 00000100:00100000:2.0:1790945555.790806:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273637120 00000100:00100000:2.0:1790945555.790873:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790945555.790896:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1877942273637120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790945555.790933:0:6670:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1790945555.790964:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6abfa913, atime: 0x6abfa913, ctime: 0x6abfa913, blocks: 0xb 00010000:00010000:2.0:1790945555.790973:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d40f9c4/0xc5cf2c2a6a54f57c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.790989:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1790945555.790993:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945555.790999:0:6670:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d40f9c4/0xc5cf2c2a6a54f57c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.791012:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d40f9c4/0xc5cf2c2a6a54f57c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.791197:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d40f9c4/0xc5cf2c2a6a54f57c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.791206:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d40f9c4/0xc5cf2c2a6a54f57c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.791229:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790945555.791775:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3294:x1877942273637120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 879us (1120us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790945555.791784:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:3.0:1790945555.791827:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb8814ad180/2, rc 0, transno 4294967301 00000100:00100000:3.0:1790945555.791834:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8814ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273637120:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790945555.791869:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945555.791877:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d40f9c4/0xc5cf2c2a6a54f57c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.791886:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434afa00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945555.791891:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d40f9c4/0xc5cf2c2a6a54f57c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.791900:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d40f9c4/0xc5cf2c2a6a54f57c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.791916:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d40f9c4/0xc5cf2c2a6a54f57c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.791941:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d40f9c4/0xc5cf2c2a6a54f57c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.791961:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945555.791963:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945555.791965:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945555.796812:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945555.796907:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254728960 00000100:00100000:0.0:1790945555.796919:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254728960 00000100:00100000:0.0:1790945555.796981:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 46 00000100:00100000:0.0:1790945555.796991:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:10310:x1877942254728960:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945555.797030:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945555.797058:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f583 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945555.797447:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790945555.797716:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f583 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81a0 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.797733:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb845042600) 00010000:00010000:0.0:1790945555.797737:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945555.797743:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f583 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81a0 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945555.797755:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1cc00, rc 0) 00000100:00100000:2.0:1790945555.797935:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:10310:x1877942254728960:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 929us (1117us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1790945555.797945:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 46 00000100:00100000:1.0:1790945555.803939:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945555.804108:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254729088 00000100:00100000:3.0:1790945555.804119:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254729088 00000100:00100000:3.0:1790945555.804185:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 47 00000100:00100000:3.0:1790945555.804197:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:10310:x1877942254729088:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:3.0:1790945555.804277:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f591 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804298:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f591 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804308:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f591 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804321:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f598 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804328:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804334:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804622:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f59f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804631:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804649:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790945555.804710:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804723:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f591 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804730:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f591 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804738:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f591 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804744:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945555.804750:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f591 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804757:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f591 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804769:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:3.0:1790945555.804772:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945555.804778:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f591 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804784:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f591 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804797:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804809:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f598 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804816:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804821:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945555.804824:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804830:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804838:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb851c9a100) 00010000:00010000:3.0:1790945555.804840:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945555.804843:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f598 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804849:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f598 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804879:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804886:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f59f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804892:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f59f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804897:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945555.804906:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f59f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804912:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f59f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804920:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:3.0:1790945555.804922:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945555.804926:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f59f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.804932:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f59f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945555.805024:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:10310:x1877942254729088:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 827us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945555.805033:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 47 00000100:00100000:3.0:1790945555.807967:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945555.808055:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254729344 00000100:00100000:0.0:1790945555.808065:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254729344 00000100:00100000:0.0:1790945555.808149:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:0.0:1790945555.808159:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:10310:x1877942254729344:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1790945555.808390:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:10310:x1877942254729344:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 232us (430us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1790945555.808398:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:2.0:1790945555.856303:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945555.856444:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254729600 00000100:00100000:3.0:1790945555.856456:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254729600 00000100:00100000:3.0:1790945555.856521:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 48 00000100:00100000:3.0:1790945555.856532:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:10313:x1877942254729600:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945555.856558:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945555.856578:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f5a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81a7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.856699:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f5ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.856715:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f5ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.856741:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f5ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.856756:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f5b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.856763:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.856769:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.857895:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f5bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.857910:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f5bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858007:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f5bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945555.858020:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790945555.858227:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f5ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858235:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f5ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858242:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f5ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858248:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945555.858252:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f5ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858260:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f5ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858272:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:2.0:1790945555.858276:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945555.858281:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f5ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858287:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4200/0xc5cf2c2a6a54f5ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858310:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858316:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f5b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858323:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858327:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945555.858330:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858337:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f5b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858345:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb851c9a100) 00010000:00010000:2.0:1790945555.858347:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945555.858350:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f5b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858357:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f5b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858406:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f5a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81a7 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858420:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f5bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81a7 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945555.858438:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:2.0:1790945555.858441:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945555.858444:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434ae600, rc 0) 00000100:00100000:2.0:1790945555.858578:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:10313:x1877942254729600:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2047us (2285us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1790945555.858586:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 48 00000100:00100000:1.0:1790945555.864920:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945555.865445:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254729728 00000100:00100000:3.0:1790945555.865459:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254729728 00000100:00100000:3.0:1790945555.865521:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 49 00000100:00100000:3.0:1790945555.865531:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:10313:x1877942254729728:12345-192.168.202.48@tcp:54:lfs.0 00010000:00010000:3.0:1790945555.865601:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f5c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.865620:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.865632:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.865692:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.865701:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f5c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.865723:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f5c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.865730:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945555.865735:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f5c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.865743:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f5c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.865756:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:3.0:1790945555.865760:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945555.865764:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f5c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945555.865771:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f5c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945555.865854:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:10313:x1877942254729728:12345-192.168.202.48@tcp:54:lfs.0 Request processed in 324us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945555.865871:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 49 00000100:00100000:1.0:1790945555.869319:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945555.869457:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254729984 00000100:00100000:0.0:1790945555.869468:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254729984 00000100:00100000:0.0:1790945555.869524:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:0.0:1790945555.869535:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:10313:x1877942254729984:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1790945555.869791:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:10313:x1877942254729984:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 257us (480us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1790945555.869798:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11 00010000:00010000:3.0:1790945556.188968:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945556.272764:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945556.272937:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254730240 00000100:00100000:1.0:1790945556.272955:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254730240 00000100:00100000:2.0:1790945556.273851:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 50 00000100:00100000:2.0:1790945556.273878:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:10344:x1877942254730240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1790945556.273915:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945556.273942:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f5d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.274091:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.274110:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.274127:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945556.274140:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790945556.274812:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f5d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81ae expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.274839:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81ae expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.274880:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:2.0:1790945556.274884:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945556.274888:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434af600, rc 0) 00000100:00100000:2.0:1790945556.274989:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+18:10344:x1877942254730240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1116us (2232us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1790945556.274998:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 50 00000100:00080000:0.0:1790945556.281286:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945556.291812:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945556.291901:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945556.292015:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254730496 00000100:00100000:0.0:1790945556.292030:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254730496 00000100:00100000:0.0:1790945556.292116:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:0.0:1790945556.292128:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+18:10344:x1877942254730496:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1790945556.292585:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:10344:x1877942254730496:12345-192.168.202.48@tcp:35:cat.0 Request processed in 456us (785us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1790945556.292594:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:3.0:1790945556.293311:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254730624 00000100:00100000:3.0:1790945556.293323:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254730624 00000100:00100000:3.0:1790945556.293393:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3 00000100:00100000:3.0:1790945556.293404:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:2371:x1877942254730624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945556.293421:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945556.293454:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81ae expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.293505:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:3.0:1790945556.293512:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945556.293566:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+18:2371:x1877942254730624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 164us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945556.293575:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3 00000100:00100000:1.0:1790945556.352757:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945556.354730:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254730880 00000100:00100000:3.0:1790945556.354753:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254730880 00000100:00100000:2.0:1790945556.355093:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 51 00000100:00100000:2.0:1790945556.355108:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+18:10350:x1877942254730880:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1790945556.355146:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945556.355150:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790945556.355187:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f536 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8184 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.355214:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:2.0:1790945556.355221:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945556.355238:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f5e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81b5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.355370:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.355385:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f5bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81a7 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.355394:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.355458:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f5bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81a7 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.355489:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f5bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81a7 expref: 18 pid: 5823 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945556.355506:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877942273637248:192.168.202.48@tcp:104: 00000100:00100000:2.0:1790945556.355653:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc6600 going to sleep for 11 seconds 00000100:00100000:2.0:1790945556.358635:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945556.358744:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254731008 00000100:00100000:3.0:1790945556.358757:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254731008 00010000:00010000:3.0:1790945556.358808:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f5bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81a7 expref: 19 pid: 5823 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945556.358873:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 38 00000100:00100000:3.0:1790945556.358884:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:2372:x1877942254731008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945556.358912:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945556.358921:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f5bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81a7 expref: 19 pid: 5823 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.358935:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f5bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81a7 expref: 19 pid: 5823 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.358964:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:3.0:1790945556.358970:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.358981:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.359020:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.359044:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945556.359125:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:2372:x1877942254731008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 241us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945556.359133:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 38 00010000:00010000:1.0:1790945556.365326:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f5bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81a7 expref: 18 pid: 5823 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945556.365363:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877942273637248:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945556.365423:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.365703:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.365713:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945556.365746:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790945556.366015:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f5e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81b5 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.366046:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81b5 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.366057:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:0.0:1790945556.366061:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790945556.366065:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434af600, rc 0) 00000100:00100000:0.0:1790945556.366315:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+18:10350:x1877942254730880:12345-192.168.202.48@tcp:101:dd.0 Request processed in 11209us (13573us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1790945556.366327:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 51 00000100:00100000:2.0:1790945556.372846:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945556.373059:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254731264 00000100:00100000:0.0:1790945556.373073:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254731264 00000100:00100000:0.0:1790945556.373149:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 52 00000100:00100000:0.0:1790945556.373161:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+18:10350:x1877942254731264:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:0.0:1790945556.373544:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f5fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.373566:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f5fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.373580:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f5fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790945556.373644:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1790945556.373697:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000494cbaad reply state 0000000019e49d1f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f5fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945556.373707:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945556.373863:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:10350:x1877942254731264:12345-192.168.202.48@tcp:36:dd.0 Request processed in 693us (1021us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1790945556.373872:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 52 00000020:00080000:0.0:1790945556.373879:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790945556.377134:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f5fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.377158:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f5fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.377166:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f5fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.377173:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945556.377178:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f5fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.377187:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f5fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.377206:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:1.0:1790945556.377210:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945556.377216:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f5fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.377223:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f5fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945556.717815:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945556.718725:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254731392 00000100:00100000:1.0:1790945556.718743:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254731392 00000100:00100000:1.0:1790945556.718830:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 53 00000100:00100000:1.0:1790945556.718843:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:10364:x1877942254731392:12345-192.168.202.48@tcp:101:stat.0 00010000:00010000:1.0:1790945556.718908:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945556.718935:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f601 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81bc expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.719267:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f608 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.719288:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f608 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.719302:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f608 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.719320:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f60f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.719339:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f60f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.719346:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f60f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.719834:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f616 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.719860:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81b5 expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.719869:0:7211:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f616 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.719916:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81b5 expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945556.719943:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81b5 expref: 21 pid: 5824 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945556.719960:0:7211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88165ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273637376:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945556.720500:0:7211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb850e833c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945556.722912:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945556.723088:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254731648 00000100:00100000:0.0:1790945556.723102:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254731648 00000100:00100000:0.0:1790945556.723223:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:0.0:1790945556.723235:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:5613:x1877942254731648:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790945556.723363:0:7211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88165ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273637376:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945556.723396:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f616 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945556.725418:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:5613:x1877942254731648:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 2173us (2506us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1790945556.725436:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:2.0:1790945556.731003:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945556.731532:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254731776 00000100:00100000:3.0:1790945556.731547:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254731776 00010000:00010000:3.0:1790945556.731607:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81b5 expref: 23 pid: 5824 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945556.731740:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 39 00000100:00100000:3.0:1790945556.731752:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:2373:x1877942254731776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945556.731772:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945556.731780:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81b5 expref: 23 pid: 5824 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.731794:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81b5 expref: 23 pid: 5824 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.731821:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f5ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81b5 expref: 23 pid: 5824 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.731844:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:3.0:1790945556.731862:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f616 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.731889:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.731898:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f616 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.732257:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945556.732342:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:2373:x1877942254731776:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 589us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945556.732352:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 39 00010000:00010000:2.0:1790945556.732428:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732437:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945556.732512:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790945556.732518:0:7211:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945556.732569:0:7211:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732585:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732596:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f608 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732617:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f608 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732624:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f608 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732631:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945556.732636:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f608 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732643:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f608 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732654:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:2.0:1790945556.732685:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945556.732690:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f608 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732697:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f608 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732713:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f60f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732720:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f60f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732727:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f60f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732733:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945556.732742:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f60f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732748:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f60f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732758:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb843765a00) 00010000:00010000:2.0:1790945556.732761:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945556.732765:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f60f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732771:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f60f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732823:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f601 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81bc expref: 22 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732838:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81bc expref: 21 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.732845:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:2.0:1790945556.732847:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945556.732860:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133c00, rc 0) 00000100:00100000:2.0:1790945556.732897:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:10364:x1877942254731392:12345-192.168.202.48@tcp:101:stat.0 Request processed in 14057us (15098us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945556.732904:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 53 00000100:00100000:1.0:1790945556.802300:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945556.802425:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254732032 00000100:00100000:0.0:1790945556.802439:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254732032 00000100:00100000:0.0:1790945556.802521:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 54 00000100:00100000:0.0:1790945556.802533:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:10370:x1877942254732032:12345-192.168.202.48@tcp:36:truncate.0 00010000:00010000:0.0:1790945556.802613:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945556.802648:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f616 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81bc expref: 21 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.802738:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:0.0:1790945556.802744:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945556.803242:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f61d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.803262:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f61d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945556.803293:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f61d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945556.803376:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1790945556.803404:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d508c227 reply state 000000007024b5b3 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f61d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945556.803422:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790945556.803769:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:10370:x1877942254732032:12345-192.168.202.48@tcp:36:truncate.0 Request processed in 1235us (1480us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1790945556.803780:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 54 00000020:00080000:2.0:1790945556.803789:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790945556.812715:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f61d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.812740:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f61d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.812749:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f61d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.812756:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434afa00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945556.812762:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f61d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.812771:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f61d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.812791:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:3.0:1790945556.812794:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945556.812800:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f61d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945556.812831:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f61d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945556.985402:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945556.986169:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254732160 00000100:00100000:0.0:1790945556.986196:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254732160 00000100:00100000:0.0:1790945556.986281:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 55 00000100:00100000:0.0:1790945556.986294:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:10384:x1877942254732160:12345-192.168.202.48@tcp:101:stat.0 00010000:00010000:0.0:1790945556.986326:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945556.986354:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f624 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81c3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.986888:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54f62b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.986908:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54f62b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.986922:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54f62b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.986940:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f632 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.986947:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.986954:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.993442:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.993485:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.993501:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945556.994736:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1790945556.994748:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945556.994818:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.994864:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.994876:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54f62b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.994884:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54f62b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.994892:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54f62b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.994900:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1ca00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945556.994905:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54f62b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.994915:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54f62b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.994933:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:0.0:1790945556.994936:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945556.994942:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54f62b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.994949:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54f62b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.994968:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.994974:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f632 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.997030:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.997047:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945556.997053:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.997064:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f632 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.997085:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb8510c8000) 00010000:00010000:0.0:1790945556.997089:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945556.997094:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f632 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.997101:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f632 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.997198:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f624 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81c3 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.997216:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81c3 expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945556.997224:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:0.0:1790945556.997226:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945556.997229:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c200, rc 0) 00000100:00100000:0.0:1790945556.997341:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:10384:x1877942254732160:12345-192.168.202.48@tcp:101:stat.0 Request processed in 11048us (11952us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945556.997361:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 55 00000100:00100000:0.0:1790945557.122535:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945557.123148:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254732416 00000100:00100000:1.0:1790945557.123162:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254732416 00000100:00100000:1.0:1790945557.123300:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 56 00000100:00100000:1.0:1790945557.123312:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:10394:x1877942254732416:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1790945557.123341:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945557.123368:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54f640 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81ca expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945557.123489:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790945557.123700:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54f640 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81ca expref: 25 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.123718:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb845042600) 00010000:00010000:1.0:1790945557.123722:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790945557.123729:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54f640 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81ca expref: 25 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.123765:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133000, rc 0) 00000100:00100000:1.0:1790945557.125622:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+24:10394:x1877942254732416:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2295us (3085us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1790945557.125637:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 56 00000100:00100000:1.0:1790945557.130488:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945557.130601:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254732672 00000100:00100000:2.0:1790945557.130615:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254732672 00000100:00100000:2.0:1790945557.130758:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:2.0:1790945557.130773:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+24:10394:x1877942254732672:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1790945557.131508:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:10394:x1877942254732672:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 733us (1029us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1790945557.131518:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:3.0:1790945557.141457:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945557.141509:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945557.141550:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945557.141794:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254732800 00000100:00100000:1.0:1790945557.141807:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254732800 00000100:00100000:1.0:1790945557.142205:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 286 00000100:00100000:1.0:1790945557.142220:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254732800:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945557.142320:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254732800:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 104us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945557.142328:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 286 00000100:00100000:0.0:1790945557.142987:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254732928 00000100:00100000:0.0:1790945557.142996:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254732928 00000100:00100000:0.0:1790945557.143055:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 71 00000100:00100000:0.0:1790945557.143064:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254732928:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945557.143132:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254732928:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 69us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945557.143140:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 71 00000100:00080000:1.0:1790945557.143534:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945557.143826:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254733056 00000100:00100000:2.0:1790945557.143834:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254733056 00000100:00100000:2.0:1790945557.143896:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 130 00000100:00100000:2.0:1790945557.143908:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254733056:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945557.143968:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254733056:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 64us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945557.143984:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 130 00000100:00080000:1.0:1790945557.144997:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790945557.213221:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945557.234426:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945557.237758:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254733312 00000100:00100000:2.0:1790945557.237783:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254733312 00000100:00100000:2.0:1790945557.237907:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 57 00000100:00100000:2.0:1790945557.237920:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:10401:x1877942254733312:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:2.0:1790945557.237958:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945557.237988:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f64e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81d1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945557.238136:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945557.238155:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f639 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81c3 expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945557.238166:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945557.238224:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81c3 expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945557.238242:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81c3 expref: 26 pid: 5824 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945557.238258:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273637504:192.168.202.48@tcp:104: 00000100:00100000:2.0:1790945557.238407:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945557.242021:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273637504:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945557.242365:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945557.242772:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945557.243574:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254733440 00000100:00100000:3.0:1790945557.243588:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254733440 00010000:00010000:3.0:1790945557.243646:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81c3 expref: 27 pid: 5824 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945557.243712:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 40 00000100:00100000:3.0:1790945557.243724:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:2373:x1877942254733440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945557.243743:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945557.243752:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81c3 expref: 27 pid: 5824 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.243766:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81c3 expref: 27 pid: 5824 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.243794:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81c3 expref: 27 pid: 5824 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.243816:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:3.0:1790945557.243822:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.243862:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.243871:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.243912:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945557.243997:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+26:2373:x1877942254733440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 275us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945557.244005:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 40 00010000:00010000:1.0:1790945557.244914:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.244928:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945557.244953:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1790945557.245453:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f64e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81d1 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.245479:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81d1 expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.245507:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:1.0:1790945557.245511:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790945557.245514:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434af600, rc 0) 00000100:00100000:1.0:1790945557.245583:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+26:10401:x1877942254733312:12345-192.168.202.48@tcp:101:bash.0 Request processed in 7665us (11171us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1790945557.245593:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 57 00000100:00100000:1.0:1790945557.252939:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945557.253054:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254733696 00000100:00100000:2.0:1790945557.253068:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254733696 00000100:00100000:2.0:1790945557.253492:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 58 00000100:00100000:2.0:1790945557.253506:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+26:10401:x1877942254733696:12345-192.168.202.48@tcp:36:bash.0 00010000:00010000:2.0:1790945557.253950:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f663 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945557.253973:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945557.253987:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945557.254051:0:7211:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1790945557.254079:0:7211:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000041294078 reply state 00000000906d299c transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945557.254102:0:7211:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790945557.254246:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:10401:x1877942254733696:12345-192.168.202.48@tcp:36:bash.0 Request processed in 742us (1319us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1790945557.254254:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 58 00000020:00080000:2.0:1790945557.254260:0:7211:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790945557.257515:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.257541:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f663 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.257549:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f663 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.257556:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434ae400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945557.257562:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f663 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.257570:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f663 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.257594:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:1.0:1790945557.257598:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945557.257604:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f663 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.257610:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f663 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945557.263601:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945557.263732:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254733824 00000100:00100000:0.0:1790945557.263747:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254733824 00000100:00100000:0.0:1790945557.263819:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 59 00000100:00100000:0.0:1790945557.263831:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+28:10401:x1877942254733824:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1790945557.263893:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945557.263921:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f66a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81d8 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.264060:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.264078:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81d1 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.264089:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f671 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.264147:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81d1 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.264164:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81d1 expref: 29 pid: 5823 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945557.264608:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877942273637632:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945557.264880:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb851fac6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945557.275773:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945557.276460:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254733952 00000100:00100000:3.0:1790945557.276474:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254733952 00010000:00010000:3.0:1790945557.276536:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81d1 expref: 30 pid: 5823 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945557.276587:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 41 00000100:00100000:3.0:1790945557.276599:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:2372:x1877942254733952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945557.276619:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945557.276627:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81d1 expref: 30 pid: 5823 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.276644:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81d1 expref: 30 pid: 5823 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.276706:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:3.0:1790945557.276712:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.276751:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.276760:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f671 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.276786:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945557.276976:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:2372:x1877942254733952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 377us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945557.276985:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 41 00010000:00010000:0.0:1790945557.278773:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f655 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81d1 expref: 29 pid: 5823 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945557.278803:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877942273637632:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945557.278834:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.279412:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.279425:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945557.279491:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790945557.279497:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945557.279523:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.280287:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f66a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81d8 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.280411:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81d8 expref: 28 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.280423:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:0.0:1790945557.280426:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945557.280431:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1cc00, rc 0) 00000100:00100000:0.0:1790945557.280700:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+28:10401:x1877942254733824:12345-192.168.202.48@tcp:101:bash.0 Request processed in 16869us (17113us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945557.280711:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 59 00000100:00100000:2.0:1790945557.315522:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945557.316418:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254734208 00000100:00100000:0.0:1790945557.316436:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254734208 00000100:00100000:0.0:1790945557.316554:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:0.0:1790945557.316567:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8477f2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+28:10401:x1877942254734208:12345-192.168.202.48@tcp:35:bash.0 00000100:00100000:0.0:1790945557.317005:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8477f2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:10401:x1877942254734208:12345-192.168.202.48@tcp:35:bash.0 Request processed in 439us (1496us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1790945557.317016:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:2.0:1790945557.430823:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945557.431329:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254734464 00000100:00100000:0.0:1790945557.431354:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254734464 00000100:00100000:0.0:1790945557.431438:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 60 00000100:00100000:0.0:1790945557.431451:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:10411:x1877942254734464:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945557.431486:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945557.431514:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f678 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81df expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945557.431639:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790945557.431880:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f678 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81df expref: 31 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.431896:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb845042600) 00010000:00010000:0.0:1790945557.431900:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945557.431907:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f678 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81df expref: 31 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.431938:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d200, rc 0) 00000100:00100000:0.0:1790945557.432562:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:10411:x1877942254734464:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1109us (1752us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1790945557.432573:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 60 00000100:00100000:2.0:1790945557.438308:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945557.438495:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254734592 00000100:00100000:1.0:1790945557.438509:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254734592 00000100:00100000:1.0:1790945557.438626:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:1.0:1790945557.438640:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:10411:x1877942254734592:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:1.0:1790945557.438772:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f686 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.438795:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.438808:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.438827:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f68d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.438835:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f68d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.438841:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f68d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439451:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439465:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439473:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790945557.439541:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439558:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439566:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f686 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439574:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f686 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439580:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945557.439586:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f686 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439594:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f686 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439609:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:1.0:1790945557.439613:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945557.439619:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f686 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439625:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f686 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439641:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f68d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439647:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f68d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439687:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f68d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439692:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945557.439695:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f68d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439702:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f68d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439711:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb843765c00) 00010000:00010000:1.0:1790945557.439713:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945557.439716:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f68d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439722:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f68d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439745:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439752:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f694 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439759:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439764:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945557.439767:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439784:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439792:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:1.0:1790945557.439795:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945557.439798:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f694 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.439803:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945557.440221:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:10411:x1877942254734592:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 1579us (1922us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945557.440232:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:2.0:1790945557.444298:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945557.444456:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254734848 00000100:00100000:3.0:1790945557.444471:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254734848 00000100:00100000:3.0:1790945557.444569:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:3.0:1790945557.444580:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:10411:x1877942254734848:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1790945557.444916:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+31:10411:x1877942254734848:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 337us (631us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1790945557.444932:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:2.0:1790945557.487809:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945557.487956:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254735104 00000100:00100000:1.0:1790945557.487977:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254735104 00000100:00100000:1.0:1790945557.488057:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:1.0:1790945557.488069:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+31:10414:x1877942254735104:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1790945557.488114:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945557.488141:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f69b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81e6 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488237:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488252:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488262:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488293:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f6a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488297:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488301:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488614:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f6b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488621:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488625:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945557.488634:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790945557.488796:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488806:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488814:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488820:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945557.488825:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488853:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488870:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:1.0:1790945557.488874:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945557.488880:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488886:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488900:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488904:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f6a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488908:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488911:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945557.488912:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488915:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f6a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488920:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb843765c00) 00010000:00010000:1.0:1790945557.488921:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945557.488923:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f6a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488934:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f6a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488981:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54f69b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81e6 expref: 34 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488992:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f6b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81e6 expref: 33 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.488997:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:1.0:1790945557.488999:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945557.489001:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133800, rc 0) 00000100:00100000:1.0:1790945557.489064:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:10414:x1877942254735104:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 999us (1274us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1790945557.489070:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:2.0:1790945557.492584:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945557.492705:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254735232 00000100:00100000:0.0:1790945557.492720:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254735232 00000100:00100000:0.0:1790945557.492791:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:0.0:1790945557.492802:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:10414:x1877942254735232:12345-192.168.202.48@tcp:54:lfs.0 00010000:00010000:0.0:1790945557.492907:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.492940:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.492955:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.492999:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.493008:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.493030:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.493036:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945557.493040:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.493046:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.493057:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:0.0:1790945557.493059:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945557.493063:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.493068:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945557.493161:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:10414:x1877942254735232:12345-192.168.202.48@tcp:54:lfs.0 Request processed in 361us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945557.493169:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:2.0:1790945557.495264:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945557.495482:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254735488 00000100:00100000:0.0:1790945557.495495:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254735488 00000100:00100000:0.0:1790945557.495564:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 17 00000100:00100000:0.0:1790945557.495575:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:10414:x1877942254735488:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1790945557.495921:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+34:10414:x1877942254735488:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 347us (669us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1790945557.495930:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 17 00000100:00100000:2.0:1790945557.498566:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945557.498703:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254735616 00000100:00100000:3.0:1790945557.498717:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254735616 00000100:00100000:3.0:1790945557.498804:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:3.0:1790945557.498816:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+34:2372:x1877942254735616:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945557.498837:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945557.498887:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54f6b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81e6 expref: 34 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.498913:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:3.0:1790945557.498936:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945557.499005:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:2372:x1877942254735616:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 191us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945557.499011:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:2.0:1790945557.669409:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945557.669531:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254735872 00000100:00100000:1.0:1790945557.669545:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254735872 00000100:00100000:1.0:1790945557.669616:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:1.0:1790945557.669627:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:10432:x1877942254735872:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1790945557.669687:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945557.669715:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f6c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81ed expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.669854:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.669872:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.669901:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945557.669914:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790945557.670194:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54f6c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81ed expref: 36 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.670218:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81ed expref: 35 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.670228:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:1.0:1790945557.670232:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790945557.670236:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133e00, rc 0) 00000100:00100000:1.0:1790945557.670319:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:10432:x1877942254735872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 694us (934us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1790945557.670327:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:1.0:1790945557.693291:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945557.693432:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254736000 00000100:00100000:0.0:1790945557.693447:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254736000 00000100:00100000:0.0:1790945557.693521:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:0.0:1790945557.693532:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:10433:x1877942254736000:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945557.693566:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945557.693591:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81f4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.693734:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54f6e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.693751:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54f6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.693763:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54f6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945557.693807:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790945557.693811:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945557.693833:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54f6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.693877:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81f4 expref: 37 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.693900:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54f6e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81f4 expref: 36 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.693909:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:0.0:1790945557.693913:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945557.693934:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1da00, rc 0) 00000100:00100000:0.0:1790945557.694008:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:10433:x1877942254736000:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 478us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945557.694017:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:3.0:1790945557.700722:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945557.700839:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254736384 00000100:00100000:0.0:1790945557.700861:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254736384 00000100:00100000:0.0:1790945557.700936:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 18 00000100:00100000:0.0:1790945557.700949:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:10433:x1877942254736384:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1790945557.701602:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+37:10433:x1877942254736384:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 651us (890us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1790945557.701613:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 18 00000100:00100000:2.0:1790945557.704401:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945557.704504:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254736512 00000100:00100000:3.0:1790945557.704518:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254736512 00000100:00100000:3.0:1790945557.704600:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:3.0:1790945557.704612:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+37:10433:x1877942254736512:12345-192.168.202.48@tcp:103:lfs.0 00010000:00010000:3.0:1790945557.704633:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790945557.704701:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81d8 expref: 37 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.704730:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f6cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81ed expref: 36 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.704746:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f575 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8199 expref: 35 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.704760:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8200) 00010000:00010000:3.0:1790945557.704774:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945557.704857:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+34:10433:x1877942254736512:12345-192.168.202.48@tcp:103:lfs.0 Request processed in 247us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945557.704864:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:1.0:1790945557.706906:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945557.707275:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254736640 00000100:00100000:2.0:1790945557.707287:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254736640 00000100:00100000:2.0:1790945557.707359:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:2.0:1790945557.707370:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+34:10433:x1877942254736640:12345-192.168.202.48@tcp:58:lfs.0 00010000:00010000:2.0:1790945557.707510:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f6e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945557.707532:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f6e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945557.707545:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f6e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790945557.708466:0:7211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945557.708735:0:7211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1790945557.708818:0:7211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1790945557.708981:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+34:10433:x1877942254736640:12345-192.168.202.48@tcp:58:lfs.0 Request processed in 1606us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945557.708993:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:2.0:1790945557.733450:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945557.733616:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254736768 00000100:00100000:0.0:1790945557.733630:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254736768 00000100:00100000:0.0:1790945557.733739:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 67 00000100:00100000:0.0:1790945557.733752:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+34:10435:x1877942254736768:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945557.733781:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945557.733810:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c81fb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.733908:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f6f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.733926:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f6f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.733940:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f6f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.733959:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f6fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.733984:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f6fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.733991:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f6fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734455:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f704 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734465:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734474:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945557.734518:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790945557.734523:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945557.734547:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734560:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734569:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f6f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734576:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f6f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734583:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f6f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734602:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945557.734609:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f6f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734617:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f6f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734632:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:0.0:1790945557.734635:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945557.734640:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f6f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734646:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f6f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734763:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f6fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734771:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f6fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734777:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f6fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734782:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945557.734785:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f6fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734791:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f6fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734810:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb8510c8000) 00010000:00010000:0.0:1790945557.734812:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945557.734815:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f6fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734821:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f6fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734870:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f6ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81fb expref: 36 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734886:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81fb expref: 35 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.734894:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb845042c00) 00010000:00010000:0.0:1790945557.734896:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945557.734899:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d800, rc 0) 00000100:00100000:1.0:1790945557.737609:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:10435:x1877942254736768:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3840us (4155us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945557.737625:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 67 00000040:00080000:2.0:1790945557.922377:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945557.922391:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945557.922456:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790945557.922464:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790945557.922640:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716bd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1877942273637760:192.168.202.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790945557.922804:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945557.933232:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716bd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1877942273637760:192.168.202.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790945557.945048:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945557.950355:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254736896 00000100:00100000:3.0:1790945557.950386:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254736896 00000100:00100000:3.0:1790945557.951931:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:3.0:1790945557.951952:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:10446:x1877942254736896:12345-192.168.202.48@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1790945557.952095:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:10446:x1877942254736896:12345-192.168.202.48@tcp:900:lhsmtool_posix.0 Request processed in 151us (7058us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945557.952103:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:0.0:1790945557.961623:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945557.961744:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254737024 00000100:00100000:1.0:1790945557.961758:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254737024 00000100:00100000:1.0:1790945557.961828:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:1.0:1790945557.961847:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:10446:x1877942254737024:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790945557.961891:0:5824:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790945557.962205:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:10446:x1877942254737024:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 Request processed in 366us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945557.962214:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:3.0:1790945557.965395:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945557.965451:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254737152 00000100:00100000:3.0:1790945557.965464:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254737152 00000100:00100000:3.0:1790945557.966878:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:3.0:1790945557.966897:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:10446:x1877942254737152:12345-192.168.202.48@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790945557.967011:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f70b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967045:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f70b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967060:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f70b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967389:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f712 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967415:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f712 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967428:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f712 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967463:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f719 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967492:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967499:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945557.967543:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790945557.967548:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790945557.967561:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967572:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f70b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967578:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f70b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967584:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f70b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967590:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945557.967594:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f70b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967602:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f70b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967613:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a900) 00010000:00010000:3.0:1790945557.967616:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945557.967620:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f70b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967637:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5600/0xc5cf2c2a6a54f70b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967654:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f712 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967700:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f712 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967706:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f712 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967711:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945557.967714:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f712 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967721:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f712 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967729:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9bb851c9af00) 00010000:00010000:3.0:1790945557.967731:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945557.967734:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f712 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967740:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f712 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967756:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967762:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f719 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967774:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f719 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967780:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945557.967782:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f719 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967789:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f719 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967796:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb845042c00) 00010000:00010000:3.0:1790945557.967799:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945557.967801:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f719 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945557.967806:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f719 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945557.967978:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:10446:x1877942254737152:12345-192.168.202.48@tcp:34:lhsmtool_posix.0 Request processed in 1083us (2593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945557.967989:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:3.0:1790945557.971457:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945557.971807:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254737408 00000100:00100000:0.0:1790945557.971824:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254737408 00000100:00100000:0.0:1790945557.971908:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 70 00000100:00100000:0.0:1790945557.971924:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:10446:x1877942254737408:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945557.971947:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945557.971969:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f720 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8202 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.972214:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f727 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.972241:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.972253:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945557.972265:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790945557.972364:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.972373:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f727 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.972379:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.972386:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945557.972391:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.972400:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f727 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.972412:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb845042c00) 00010000:00010000:0.0:1790945557.972415:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945557.972420:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f727 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.972426:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f727 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.972471:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f720 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8202 expref: 37 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.972487:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a900) 00010000:00010000:0.0:1790945557.972490:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945557.972494:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f720 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8202 expref: 37 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945557.972503:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c000, rc 0) 00000100:00100000:0.0:1790945557.972724:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:10446:x1877942254737408:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 804us (1280us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1790945557.972732:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 70 00000100:00100000:3.0:1790945557.975228:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945557.976216:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254737536 00000100:00100000:1.0:1790945557.976234:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254737536 00000100:00100000:1.0:1790945557.976314:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 71 00000100:00100000:1.0:1790945557.976327:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:10446:x1877942254737536:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790945557.976376:0:5825:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790945557.976548:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:10446:x1877942254737536:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 Request processed in 224us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945557.976557:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 71 00000100:00100000:3.0:1790945557.987528:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945557.988690:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254737792 00000100:00100000:1.0:1790945557.988707:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254737792 00000100:00100000:1.0:1790945557.988786:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 72 00000100:00100000:1.0:1790945557.988799:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:10446:x1877942254737792:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945557.988829:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945557.988833:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790945557.988876:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54f6e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81f4 expref: 36 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.988899:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:1.0:1790945557.988906:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790945557.988934:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f735 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8209 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790945557.989741:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1790945557.990797:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f73c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.990836:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f73c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.990858:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f73c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.990947:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f735 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8209 expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.990969:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f73c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8209 expref: 37 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945557.990979:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb843765c00) 00010000:00010000:1.0:1790945557.990983:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945557.990986:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132800, rc 0) 00000100:00100000:1.0:1790945557.991506:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+37:10446:x1877942254737792:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 2707us (3989us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1790945557.991517:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 72 00000100:00100000:0.0:1790945558.004418:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945558.004517:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254738048 00000100:00100000:2.0:1790945558.004531:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254738048 00000100:00100000:2.0:1790945558.004622:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 73 00000100:00100000:2.0:1790945558.004635:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+37:10446:x1877942254738048:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790945558.004739:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945558.004774:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f73c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8209 expref: 37 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.004813:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb843765c00) 00010000:00010000:2.0:1790945558.004831:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945558.004868:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f74a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.004885:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f74a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.004895:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f74a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790945558.005354:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790945558.007118:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f751 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x98a36b2b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.007146:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x98a36b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.007159:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x98a36b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.007581:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f74a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.007590:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f74a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.007597:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f74a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.007615:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434aea00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945558.007620:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f74a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.007934:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f74a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.007949:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:0.0:1790945558.007952:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945558.007957:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f74a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.007963:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f74a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.007978:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x98a36b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.007985:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f751 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x98a36b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.007992:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f751 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x98a36b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.007997:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945558.008001:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f751 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x98a36b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.008008:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f751 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x98a36b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.008028:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x98a36b2b (ffff9bb8510c8000) 00010000:00010000:0.0:1790945558.008031:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945558.008034:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f751 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x98a36b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.008040:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f751 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x98a36b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945558.008156:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:10446:x1877942254738048:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 3519us (3747us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790945558.008166:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 73 00000100:00100000:0.0:1790945558.012567:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.013910:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254738176 00000100:00100000:3.0:1790945558.013924:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254738176 00000100:00100000:3.0:1790945558.014110:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 74 00000100:00100000:3.0:1790945558.014121:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:10446:x1877942254738176:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945558.014142:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945558.014190:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f758 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8210 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.014227:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f75f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.014240:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f75f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.014252:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f75f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.014957:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f758 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8210 expref: 38 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.014980:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f75f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8210 expref: 37 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.014989:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb851c9af00) 00010000:00010000:3.0:1790945558.014992:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790945558.015127:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4800, rc 0) 00000100:00100000:3.0:1790945558.015278:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+37:10446:x1877942254738176:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 1158us (2720us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945558.015287:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 74 00000100:00100000:3.0:1790945558.020031:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945558.022768:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254738432 00000100:00100000:0.0:1790945558.022787:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254738432 00000100:00100000:0.0:1790945558.022868:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 75 00000100:00100000:0.0:1790945558.022881:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+37:10446:x1877942254738432:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790945558.022976:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f766 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.023006:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f766 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.025284:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f766 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790945558.025818:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1790945558.025829:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 303821171109ns, next at 304821168805ns, rc = 0 00000004:00010000:0.0:1790945558.025929:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000064cc9d03 reply state 000000001b457356 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f766 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945558.025953:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945558.027848:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+39:10446:x1877942254738432:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 4951us (8173us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1790945558.027863:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 75 00010000:00010000:0.0:1790945558.031523:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f766 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.031540:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f766 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.031547:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f766 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.031553:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945558.031558:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f766 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.031566:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f766 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.031583:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb851c9af00) 00010000:00010000:0.0:1790945558.031586:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790945558.031590:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f766 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.031597:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f766 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945558.031877:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945558.037479:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254738560 00000100:00100000:0.0:1790945558.037497:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254738560 00000100:00100000:0.0:1790945558.037577:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 76 00000100:00100000:0.0:1790945558.037588:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+38:10446:x1877942254738560:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945558.037612:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945558.037634:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f76d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8217 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.037718:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f76d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8217 expref: 39 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.037734:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f76d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8217 expref: 39 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.037754:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb851c9af00) 00010000:00010000:0.0:1790945558.037757:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790945558.037760:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c400, rc 0) 00000100:00100000:0.0:1790945558.037824:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+39:10446:x1877942254738560:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 238us (5952us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945558.037831:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 76 00000100:00100000:0.0:1790945558.042811:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.043057:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254738688 00000100:00100000:3.0:1790945558.043066:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254738688 00000100:00100000:3.0:1790945558.043119:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 25 00000100:00100000:3.0:1790945558.043128:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2369:x1877942254738688:12345-192.168.202.48@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1790945558.043170:0:7919:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:3.0:1790945558.043321:0:7919:0:(genops.c:1384:class_connect()) connect: client c6be5708-366a-4e39-b76f-5dba2d1f1a3b, cookie 0xc5cf2c2a6a54f774 00002000:00100000:3.0:1790945558.043333:0:7919:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c6be5708-366a-4e39-b76f-5dba2d1f1a3b/ffff9bb86023a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790945558.043356:0:7919:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790945558.043571:0:7919:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790945558.043602:0:7919:0:(import.c:65:import_set_state_nolock()) ffff9bb846041000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790945558.043701:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2369:x1877942254738688:12345-192.168.202.48@tcp:8:lhsmtool_posix.0 Request processed in 571us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945558.043708:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 25 00000100:00100000:3.0:1790945558.052181:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.052230:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254738816 00000100:00100000:3.0:1790945558.052242:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254738816 00000100:00100000:3.0:1790945558.052324:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 26 00000100:00100000:3.0:1790945558.052337:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:0:x1877942254738816:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790945558.052743:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1790945558.174160:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1790945558.174179:0:7627:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000100:00100000:2.0:1790945558.174302:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:0:x1877942254738816:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 Request processed in 121959us (122128us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790945558.174316:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 26 00000100:00100000:3.0:1790945558.193260:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945558.193368:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254739072 00000100:00100000:2.0:1790945558.193383:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254739072 00000100:00100000:2.0:1790945558.193474:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 19 00000100:00100000:2.0:1790945558.193485:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+39:10446:x1877942254739072:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790945558.193867:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+40:10446:x1877942254739072:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 383us (621us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1790945558.193888:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 19 00000100:00100000:2.0:1790945558.212637:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.213024:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254739328 00000100:00100000:3.0:1790945558.213040:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254739328 00000100:00100000:3.0:1790945558.213111:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 77 00000100:00100000:3.0:1790945558.213123:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+40:10446:x1877942254739328:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790945558.213315:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+40:10446:x1877942254739328:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 194us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945558.213325:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 77 00000100:00100000:3.0:1790945558.226883:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945558.226981:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254739456 00000100:00100000:0.0:1790945558.226993:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254739456 00000100:00100000:0.0:1790945558.227068:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 78 00000100:00100000:0.0:1790945558.227081:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+40:10446:x1877942254739456:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945558.227110:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945558.227136:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f77b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c821e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.227252:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f782 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.227271:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.227289:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945558.227338:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945558.227363:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.227396:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f77b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c821e expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.227413:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c821e expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.227433:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb851c9af00) 00010000:00010000:0.0:1790945558.227436:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790945558.227442:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d600, rc 0) 00000100:00100000:0.0:1790945558.227524:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:10446:x1877942254739456:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 445us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945558.227532:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 78 00010000:00010000:1.0:1790945558.247084:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945558.251889:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.252058:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254739584 00000100:00100000:3.0:1790945558.252089:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254739584 00000100:00100000:3.0:1790945558.252167:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 27 00000100:00100000:3.0:1790945558.252179:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2372:x1877942254739584:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945558.252202:0:7919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945558.252234:0:7919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e403eeb2/0xc5cf2c2a6a54f789 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8225 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945558.252270:0:7919:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfa916, blocks: 0x1 00010000:00010000:3.0:1790945558.252294:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=304s v=(0 0) 00010000:00010000:3.0:1790945558.252300:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945558.252312:0:7919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e403eeb2/0xc5cf2c2a6a54f789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8225 expref: 6 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.252347:0:7919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e403eeb2/0xc5cf2c2a6a54f789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8225 expref: 6 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.252363:0:7919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4600, rc 0) 00000100:00100000:3.0:1790945558.252458:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254739584:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 280us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945558.252466:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 27 00000100:00100000:2.0:1790945558.267522:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.267728:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254739840 00000100:00100000:3.0:1790945558.267743:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254739840 00000100:00100000:3.0:1790945558.267827:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00100000:3.0:1790945558.267849:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:10446:x1877942254739840:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790945558.268003:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:10446:x1877942254739840:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 166us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945558.268024:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00100000:1.0:1790945558.275919:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.276260:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254739968 00000100:00100000:3.0:1790945558.276274:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254739968 00000100:00100000:3.0:1790945558.276351:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 28 00000100:00100000:3.0:1790945558.276364:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:10446:x1877942254739968:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945558.276392:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945558.276417:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074959b7c/0xc5cf2c2a6a54f790 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c822c expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.276472:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e403eeb2/0xc5cf2c2a6a54f789 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8225 expref: 7 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.276483:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945558.276489:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945558.276495:0:6672:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074959b7c/0xc5cf2c2a6a54f790 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c822c expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.276542:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e403eeb2/0xc5cf2c2a6a54f789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8225 expref: 7 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.276557:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e403eeb2/0xc5cf2c2a6a54f789 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8225 expref: 7 pid: 7919 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945558.276574:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8715fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1877942273637888:192.168.202.48@tcp:104: 00000100:00100000:3.0:1790945558.276732:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8654abd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945558.281823:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.281904:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8715fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1877942273637888:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945558.281932:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254740096 00000100:00100000:0.0:1790945558.281945:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254740096 00010000:00010000:3.0:1790945558.281949:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074959b7c/0xc5cf2c2a6a54f790 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c822c expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.281972:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c5600, rc 0) 00010000:00010000:0.0:1790945558.282004:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e403eeb2/0xc5cf2c2a6a54f789 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8225 expref: 8 pid: 7919 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945558.282069:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 42 00000100:00100000:0.0:1790945558.282080:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2373:x1877942254740096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945558.282099:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945558.282128:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e403eeb2/0xc5cf2c2a6a54f789 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8225 expref: 8 pid: 7919 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.282144:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e403eeb2/0xc5cf2c2a6a54f789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8225 expref: 8 pid: 7919 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.282174:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e403eeb2/0xc5cf2c2a6a54f789 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8225 expref: 8 pid: 7919 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.282193:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945558.282198:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945558.282209:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074959b7c/0xc5cf2c2a6a54f790 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c822c expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.282220:0:5808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074959b7c/0xc5cf2c2a6a54f790 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c822c expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.282266:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000074959b7c/0xc5cf2c2a6a54f790 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c822c expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945558.282283:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5808:1877942273638016:192.168.202.48@tcp:105: 00000100:00100000:3.0:1790945558.282307:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:10446:x1877942254739968:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 5942us (6400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945558.282319:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 28 00000100:00100000:0.0:1790945558.282385:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881032540 going to sleep for 11 seconds 00000100:00100000:0.0:1790945558.289339:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5808:1877942273638016:192.168.202.48@tcp:105: 00010000:00010000:0.0:1790945558.289370:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945558.289438:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254740096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7358us (7622us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945558.289452:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 42 00000100:00100000:0.0:1790945558.290845:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945558.290879:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254740224 00000100:00100000:0.0:1790945558.290888:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254740224 00002000:00100000:0.0:1790945558.290933:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9bb87f9b3480 x1877942254740224/t0(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:254/0 lens 504/0 e 0 to 0 dl 1790945569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790945558.290944:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb87f9b3480 with x1877942254740224 ext(0->8) 00002000:00010000:0.0:1790945558.290950:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb87f9b3480 00000100:00100000:0.0:1790945558.290976:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:0.0:1790945558.290985:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254740224:12345-192.168.202.48@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790945558.292156:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2373:x1877942254740224:12345-192.168.202.48@tcp:4:lhsmtool_posix.0 Request processed in 1167us (1322us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790945558.292166:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 0 00002000:00100000:0.0:1790945558.292175:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9bb87f9b3480 x1877942254740224/t4294967302(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:254/0 lens 504/448 e 0 to 0 dl 1790945569 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790945558.292185:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb87f9b3480 with x1877942254740224 ext(0->8) 00002000:00010000:0.0:1790945558.292191:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb87f9b3480 00000100:00100000:1.0:1790945558.303614:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.303808:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254740352 00000100:00100000:3.0:1790945558.303823:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254740352 00000100:00100000:3.0:1790945558.303906:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 80 00000100:00100000:3.0:1790945558.303923:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:10446:x1877942254740352:12345-192.168.202.48@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1790945558.399553:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:10446:x1877942254740352:12345-192.168.202.48@tcp:44:lhsmtool_posix.0 Request processed in 95618us (96884us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945558.399572:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 80 00000001:00080000:0.0:1790945558.399574:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1790945558.399591:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1790945558.399680:0:5846:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1790945558.399712:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1790945558.399931:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1790945558.399950:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1790945558.403445:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945558.403466:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273638144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790945558.403554:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945558.403629:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273638144 00000100:00100000:0.0:1790945558.403637:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273638144 00000100:00100000:0.0:1790945558.403711:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790945558.403720:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273638144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1790945558.403895:0:7919:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790945558.403898:0:7919:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790945558 00002000:00010000:0.0:1790945558.403900:0:7919:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790945558.403902:0:7919:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790945558 -> 1790945558 00002000:00010000:0.0:1790945558.403905:0:7919:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790945558.403948:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273638144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (393us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790945558.403955:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1790945558.403978:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1790945558.406395:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb87acfc380/2, rc 0, transno 4294967303 00000100:00100000:0.0:1790945558.406410:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273638144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790945558.411846:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.411919:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254740480 00000100:00100000:3.0:1790945558.411937:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254740480 00000100:00100000:3.0:1790945558.412028:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 30 00000100:00100000:3.0:1790945558.412040:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2372:x1877942254740480:12345-192.168.202.48@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790945558.459816:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2372:x1877942254740480:12345-192.168.202.48@tcp:16:lhsmtool_posix.0 Request processed in 47763us (47975us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945558.459831:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 30 00000001:00080000:2.0:1790945558.459973:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1790945558.459986:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1790945558.469288:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.473461:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254740736 00000100:00100000:3.0:1790945558.473478:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254740736 00000100:00100000:3.0:1790945558.473552:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:3.0:1790945558.473563:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:10446:x1877942254740736:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790945558.473618:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945558.473675:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f782 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c821e expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.473696:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb851c9af00) 00010000:00010000:3.0:1790945558.473702:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945558.473735:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f797 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.473749:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.473759:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945558.475916:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b0504a1b reply state 00000000d8deefc5 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945558.476159:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945558.476392:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:10446:x1877942254740736:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 2827us (7108us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1790945558.476416:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:1.0:1790945558.483276:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945558.483419:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254740864 00000100:00100000:0.0:1790945558.483431:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254740864 00000100:00100000:0.0:1790945558.483493:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 31 00000100:00100000:0.0:1790945558.483504:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254740864:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790945558.483800:0:7919:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790945558.483805:0:7919:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790945558 -> 1790945557 00002000:00010000:0.0:1790945558.483808:0:7919:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790945555 00002000:00010000:0.0:1790945558.483811:0:7919:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790945558 -> 1790945557 00002000:00010000:0.0:1790945558.483813:0:7919:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790945558.483883:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2373:x1877942254740864:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 Request processed in 380us (615us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790945558.483890:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 31 00010000:00010000:3.0:1790945558.483927:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.483938:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f797 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.483946:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f797 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.483953:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945558.483958:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f797 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.483967:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f797 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.483983:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb851c9af00) 00010000:00010000:3.0:1790945558.483986:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945558.483997:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f797 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.484004:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4600/0xc5cf2c2a6a54f797 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945558.487321:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.487395:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254741120 00000100:00100000:3.0:1790945558.487405:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254741120 00000100:00100000:3.0:1790945558.487466:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 82 00000100:00100000:3.0:1790945558.487476:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:10446:x1877942254741120:12345-192.168.202.48@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790945558.487541:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.487559:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f75f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8210 expref: 13 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.487568:0:7211:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.487601:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f75f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8210 expref: 13 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.487616:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f75f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8210 expref: 13 pid: 7211 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945558.487630:0:7211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8715fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273638272:192.168.202.48@tcp:104: 00000100:00100000:3.0:1790945558.487748:0:7211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b34ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945558.491408:0:7211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8715fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273638272:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945558.491437:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945558.492606:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.492732:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254741248 00000100:00100000:3.0:1790945558.492741:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254741248 00010000:00010000:3.0:1790945558.492780:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f75f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8210 expref: 14 pid: 7211 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945558.492846:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 43 00000100:00100000:3.0:1790945558.492856:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:2373:x1877942254741248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945558.492871:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945558.492878:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f75f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8210 expref: 14 pid: 7211 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.492890:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f75f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8210 expref: 14 pid: 7211 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.492911:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4800/0xc5cf2c2a6a54f75f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8210 expref: 14 pid: 7211 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.492938:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb851c9af00) 00010000:00010000:3.0:1790945558.492943:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.492952:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.492960:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.492980:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945558.493047:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:2373:x1877942254741248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 192us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945558.493056:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 43 00010000:00010000:0.0:1790945558.493554:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.493564:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.493595:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.493610:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.493618:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.493625:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945558.493630:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.493639:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.493686:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb851c9af00) 00010000:00010000:0.0:1790945558.493690:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790945558.493694:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.493701:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54f79e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945558.493755:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:10446:x1877942254741120:12345-192.168.202.48@tcp:55:lhsmtool_posix.0 Request processed in 6280us (6442us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790945558.493764:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 82 00000100:00100000:0.0:1790945558.508702:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945558.508789:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254741376 00000100:00100000:3.0:1790945558.508814:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254741376 00000100:00100000:3.0:1790945558.508880:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 32 00000100:00100000:3.0:1790945558.508890:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2372:x1877942254741376:12345-192.168.202.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790945558.508930:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.508950:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074959b7c/0xc5cf2c2a6a54f790 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c822c expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.508969:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945558.508974:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945558.508979:0:6672:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.509022:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074959b7c/0xc5cf2c2a6a54f790 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c822c expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.509037:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074959b7c/0xc5cf2c2a6a54f790 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c822c expref: 7 pid: 6672 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945558.509053:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8715ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1877942273638400:192.168.202.48@tcp:104: 00000100:00100000:3.0:1790945558.509148:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b34ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945558.528080:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945558.531012:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8715ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1877942273638400:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945558.531041:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945558.531908:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254741504 00000100:00100000:2.0:1790945558.531919:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254741504 00010000:00010000:2.0:1790945558.531958:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074959b7c/0xc5cf2c2a6a54f790 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c822c expref: 8 pid: 6672 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945558.532010:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 44 00000100:00100000:2.0:1790945558.532020:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2372:x1877942254741504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945558.532035:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945558.532058:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074959b7c/0xc5cf2c2a6a54f790 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c822c expref: 8 pid: 6672 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.532070:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074959b7c/0xc5cf2c2a6a54f790 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c822c expref: 8 pid: 6672 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.532094:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074959b7c/0xc5cf2c2a6a54f790 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c822c expref: 8 pid: 6672 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.532109:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945558.532114:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945558.532119:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.532142:0:5810:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.532170:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945558.532223:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2372:x1877942254741504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 205us (4161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945558.532231:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 44 00010000:00010000:2.0:1790945558.532351:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.532360:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.532382:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.532390:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.532398:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.532405:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945558.532409:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.532429:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.532441:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.532448:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4a55a34/0xc5cf2c2a6a54f7a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945558.532503:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254741376:12345-192.168.202.48@tcp:1:lhsmtool_posix.0 Request processed in 23614us (23846us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945558.532511:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 32 00000100:00100000:3.0:1790945558.538937:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945558.546017:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254741760 00000100:00100000:1.0:1790945558.546034:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254741760 00000100:00100000:1.0:1790945558.546114:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00100000:1.0:1790945558.546126:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:10446:x1877942254741760:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790945558.546210:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f7ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.546228:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f7ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.546239:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f7ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.546461:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.546473:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f76d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8217 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.546482:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.546517:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f76d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8217 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.546532:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f76d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8217 expref: 13 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945558.546562:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88165df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273638528:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945558.546687:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48780 going to sleep for 11 seconds 00000100:00100000:3.0:1790945558.550201:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88165df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273638528:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945558.550229:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945558.555222:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945558.555434:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254741888 00000100:00100000:1.0:1790945558.555446:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254741888 00010000:00010000:1.0:1790945558.555485:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f76d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8217 expref: 14 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945558.555530:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 45 00000100:00100000:1.0:1790945558.555539:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:2372:x1877942254741888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945558.555554:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945558.555561:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f76d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8217 expref: 14 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.555575:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f76d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8217 expref: 14 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.555597:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f76d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8217 expref: 14 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.555611:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb851c9af00) 00010000:00010000:1.0:1790945558.555616:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.555625:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.555647:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.555701:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945558.555756:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:2372:x1877942254741888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 218us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945558.555765:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 45 00010000:00010000:0.0:1790945558.555976:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.555985:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790945558.556160:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1790945558.556434:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1790945558.556486:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1790945558.556594:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88135d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5823:1877942273638656:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790945558.556645:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945558.556710:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881032a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790945558.558210:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273638656 00000100:00100000:1.0:1790945558.558222:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273638656 00000100:00100000:1.0:1790945558.558284:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790945558.558294:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1877942273638656:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790945558.558397:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1877942273638656:12345-0@lo:1000:mdt00_000.0 Request processed in 105us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945558.558404:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790945558.559162:0:5823:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1790945558.559170:0:5823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb87acfc380, transno 4294967303 00000100:00100000:0.0:1790945558.559189:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88135d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5823:1877942273638656:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790945558.559688:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1790945558.559764:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88135d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5823:1877942273638784:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790945558.559825:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945558.559867:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881032600 going to sleep for 11 seconds 00000100:00100000:2.0:1790945558.560039:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273638784 00000100:00100000:2.0:1790945558.560046:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273638784 00000100:00100000:2.0:1790945558.560086:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945558.560094:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1877942273638784:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790945558.560289:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5823:x1877942273638784:12345-0@lo:1000:mdt00_000.0 Request processed in 195us (464us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790945558.560298:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945558.560339:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88135d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5823:1877942273638784:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1790945558.560373:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560382:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560403:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560409:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133a00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945558.560423:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560433:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560450:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb851c9af00) 00010000:00010000:2.0:1790945558.560453:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945558.560458:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560465:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f7b3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560507:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f6e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560514:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f6e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560520:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f6e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560525:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434afa00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945558.560528:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f6e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560545:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f6e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560555:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb845042c00) 00010000:00010000:2.0:1790945558.560557:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945558.560561:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f6e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560565:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f6e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560587:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560600:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f704 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81fb expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560608:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560634:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81fb expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.560649:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f704 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81fb expref: 16 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945558.560684:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716be300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273638912:192.168.202.48@tcp:104: 00000100:00100000:2.0:1790945558.560748:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842f4f900 going to sleep for 11 seconds 00000100:00100000:0.0:1790945558.566317:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945558.566525:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716be300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273638912:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945558.566555:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945558.568892:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254742016 00000100:00100000:2.0:1790945558.568918:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254742016 00010000:00010000:2.0:1790945558.568962:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f704 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81fb expref: 17 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945558.569013:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 46 00000100:00100000:2.0:1790945558.569024:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+17:2373:x1877942254742016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945558.569040:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945558.569048:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f704 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81fb expref: 17 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569060:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81fb expref: 17 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569083:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f704 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c81fb expref: 17 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569098:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb845042c00) 00010000:00010000:2.0:1790945558.569104:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569119:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569126:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569153:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945558.569217:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:2373:x1877942254742016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 195us (2911us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945558.569236:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 46 00010000:00010000:2.0:1790945558.569266:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569290:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569303:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569309:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569315:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569321:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434ae400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945558.569326:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569333:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569342:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb845042c00) 00010000:00010000:2.0:1790945558.569345:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945558.569349:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569354:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569366:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f7ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569378:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f7ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569384:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f7ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569389:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133c00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945558.569392:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f7ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569398:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f7ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569407:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb845042c00) 00010000:00010000:2.0:1790945558.569410:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790945558.569413:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f7ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.569418:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f7ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945558.569621:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:10446:x1877942254741760:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 23498us (30696us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1790945558.569630:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 83 00000020:00080000:2.0:1790945558.569634:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790945558.569757:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945558.569762:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945558.569783:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790945558.569792:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790945558.600899:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945558.604849:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254742272 00000100:00100000:2.0:1790945558.604880:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254742272 00000100:00100000:2.0:1790945558.604954:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 20 00000100:00100000:2.0:1790945558.604964:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:10446:x1877942254742272:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790945558.605597:0:5826:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790945558.605720:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1790945558.605763:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.605781:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.605793:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.605802:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.605810:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.605817:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.606642:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790945558.606770:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+17:10446:x1877942254742272:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 1803us (5876us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1790945558.606780:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 20 00000020:00080000:2.0:1790945558.606786:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790945558.608681:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945558.608693:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.608703:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af600 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945558.608707:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.608716:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.608732:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bb845042300) 00010000:00010000:0.0:1790945558.608736:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790945558.608748:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7c1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.608755:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.608773:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945558.608774:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945558.608776:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790945558.704827:0:11985:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945558.704844:0:11985:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790945558.704880:0:11985:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790945558.704903:0:11985:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790945558.900539:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945558.900824:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254742528 00000100:00100000:1.0:1790945558.900844:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254742528 00000100:00100000:2.0:1790945558.901074:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 84 00000100:00100000:2.0:1790945558.901086:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+17:10456:x1877942254742528:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945558.901125:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945558.901143:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f7c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8233 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.901238:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f7cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.901254:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f7cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.901266:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f7cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945558.901303:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790945558.901422:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f7c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8233 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.901441:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f7cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8233 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.901450:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:2.0:1790945558.901454:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790945558.901457:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434ae600, rc 0) 00000100:00100000:2.0:1790945558.901523:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:10456:x1877942254742528:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 439us (994us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1790945558.901531:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 84 00000100:00100000:3.0:1790945558.905485:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945558.905615:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254742656 00000100:00100000:2.0:1790945558.905626:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254742656 00000100:00100000:2.0:1790945558.905841:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00100000:2.0:1790945558.905865:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:10456:x1877942254742656:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:2.0:1790945558.905949:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f7dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.905967:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f7dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.905979:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f7dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.905997:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906004:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906011:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906259:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906269:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906276:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945558.906316:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906329:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f7dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906342:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f7dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906349:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f7dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906356:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434afa00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945558.906361:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f7dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906369:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f7dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906381:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:2.0:1790945558.906385:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945558.906390:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f7dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906396:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f7dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906409:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906415:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906421:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906426:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434ae400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945558.906435:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906442:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906448:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb845042c00) 00010000:00010000:2.0:1790945558.906451:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945558.906454:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906459:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f7e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906473:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906479:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906484:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906489:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945558.906492:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906498:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906515:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb845042e00) 00010000:00010000:2.0:1790945558.906518:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945558.906527:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945558.906533:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f7eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945558.907007:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:10456:x1877942254742656:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 1142us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945558.907016:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00100000:1.0:1790945558.971862:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945558.972275:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254742912 00000100:00100000:0.0:1790945558.972286:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254742912 00000100:00100000:0.0:1790945558.972351:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 86 00000100:00100000:0.0:1790945558.972364:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:10459:x1877942254742912:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945558.972388:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945558.972410:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f7f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c823a expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.972483:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f7f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.972498:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f7f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.972519:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f7f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.972536:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f800 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.972544:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945558.972571:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973310:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f807 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973323:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973331:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945558.973340:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1790945558.973425:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f7f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973433:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f7f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973441:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973447:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945558.973451:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973458:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f7f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973482:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:3.0:1790945558.973485:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945558.973491:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f7f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973497:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f7f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973523:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973529:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f800 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973536:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f800 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973541:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945558.973544:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f800 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973550:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f800 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973558:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb8510c8000) 00010000:00010000:3.0:1790945558.973560:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945558.973563:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f800 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973569:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f800 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973623:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f7f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c823a expref: 22 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973636:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c823a expref: 21 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945558.973642:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb85a4d2300) 00010000:00010000:3.0:1790945558.973644:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945558.973647:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030400, rc 0) 00000100:00100000:3.0:1790945558.973758:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:10459:x1877942254742912:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1398us (1905us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1790945558.973766:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 86 00000100:00100000:0.0:1790945558.981217:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945558.981380:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254743040 00000100:00100000:1.0:1790945558.981392:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254743040 00000100:00100000:1.0:1790945558.981450:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 87 00000100:00100000:1.0:1790945558.981462:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:10459:x1877942254743040:12345-192.168.202.48@tcp:54:lfs.0 00010000:00010000:1.0:1790945558.981545:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f815 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.981574:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.981585:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.981610:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.981617:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f815 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.981625:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.981631:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945558.981635:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.981642:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f815 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.981654:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb85a4d2300) 00010000:00010000:1.0:1790945558.981705:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790945558.981711:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f815 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945558.981718:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f815 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945558.981800:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:10459:x1877942254743040:12345-192.168.202.48@tcp:54:lfs.0 Request processed in 340us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945558.981814:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 87 00000100:00100000:0.0:1790945558.985842:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945558.985952:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254743296 00000100:00100000:2.0:1790945558.985973:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254743296 00000100:00100000:2.0:1790945558.986037:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 21 00000100:00100000:2.0:1790945558.986047:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8477f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:10459:x1877942254743296:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1790945558.986272:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8477f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:10459:x1877942254743296:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 225us (450us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1790945558.986280:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 21 00000100:00100000:3.0:1790945559.030864:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.031071:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254743552 00000100:00100000:2.0:1790945559.031082:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254743552 00000100:00100000:2.0:1790945559.031143:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 88 00000100:00100000:2.0:1790945559.031154:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:9988:x1877942254743552:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:2.0:1790945559.031181:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945559.031204:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f81c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8241 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.031312:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.031327:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f807 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c823a expref: 23 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.031357:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.031391:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c823a expref: 23 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.031405:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f807 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c823a expref: 23 pid: 7211 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945559.031419:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877942273639040:192.168.202.48@tcp:104: 00000100:00100000:2.0:1790945559.031533:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842f4f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945559.038058:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.038186:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877942273639040:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945559.038214:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945559.038699:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254743680 00000100:00100000:1.0:1790945559.038708:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254743680 00010000:00010000:1.0:1790945559.038744:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f807 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c823a expref: 24 pid: 7211 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945559.038797:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 47 00000100:00100000:1.0:1790945559.038807:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+24:2372:x1877942254743680:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945559.038822:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945559.038838:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f807 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c823a expref: 24 pid: 7211 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.038852:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c823a expref: 24 pid: 7211 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.038873:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f807 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c823a expref: 24 pid: 7211 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.038888:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb85a4d2300) 00010000:00010000:1.0:1790945559.038894:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.038904:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.038911:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.038957:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945559.038996:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.039006:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945559.039022:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:2372:x1877942254743680:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 214us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945559.039031:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 47 00000004:00200000:3.0:1790945559.039040:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1790945559.039196:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f81c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8241 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.039215:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8241 expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.039223:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb85a4d2300) 00010000:00010000:3.0:1790945559.039233:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790945559.039237:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434ae400, rc 0) 00000100:00100000:3.0:1790945559.039266:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:9988:x1877942254743552:12345-192.168.202.48@tcp:101:bash.0 Request processed in 8114us (8414us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1790945559.039275:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 88 00000100:00100000:0.0:1790945559.045998:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945559.046089:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254743936 00000100:00100000:1.0:1790945559.046099:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254743936 00000100:00100000:1.0:1790945559.046165:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 89 00000100:00100000:1.0:1790945559.046176:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:9988:x1877942254743936:12345-192.168.202.48@tcp:36:bash.0 00010000:00010000:1.0:1790945559.046431:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f831 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.046448:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.046459:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945559.046525:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1790945559.046550:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008aee7451 reply state 00000000c9a61530 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945559.046559:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1790945559.046603:0:5823:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1790945559.046741:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:9988:x1877942254743936:12345-192.168.202.48@tcp:36:bash.0 Request processed in 566us (751us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1790945559.046748:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 89 00000020:00080000:1.0:1790945559.046764:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1790945559.049388:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.049407:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f831 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.049414:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.049421:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945559.049426:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.049434:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f831 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.049450:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb85a4d2300) 00010000:00010000:3.0:1790945559.049454:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945559.049459:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f831 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.049465:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f831 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945559.053458:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945559.053544:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254744064 00000100:00100000:3.0:1790945559.053554:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254744064 00000100:00100000:3.0:1790945559.053615:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 90 00000100:00100000:3.0:1790945559.053641:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+26:9988:x1877942254744064:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:3.0:1790945559.053697:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945559.053718:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f838 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8248 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.053782:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f838 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8248 expref: 27 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.053798:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f838 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8248 expref: 27 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.053819:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb85a4d2300) 00010000:00010000:3.0:1790945559.053822:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945559.053826:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840031c00, rc 0) 00000100:00100000:3.0:1790945559.053896:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:9988:x1877942254744064:12345-192.168.202.48@tcp:101:bash.0 Request processed in 258us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945559.053904:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 90 00000100:00100000:0.0:1790945559.063242:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945559.063348:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254744192 00000100:00100000:3.0:1790945559.063359:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254744192 00000100:00100000:3.0:1790945559.063424:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00100000:3.0:1790945559.063435:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:9988:x1877942254744192:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:3.0:1790945559.063455:0:7919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945559.063477:0:7919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afe28e06/0xc5cf2c2a6a54f83f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c824f expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945559.063504:0:7919:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abfa915, atime: 0x6abfa913, ctime: 0x6abfa915, blocks: 0xb 00010000:00010000:3.0:1790945559.063526:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=304s v=(0 0) 00010000:00010000:3.0:1790945559.063544:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945559.063553:0:7919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afe28e06/0xc5cf2c2a6a54f83f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c824f expref: 7 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.063571:0:7919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000afe28e06/0xc5cf2c2a6a54f83f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c824f expref: 7 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.063585:0:7919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840031200, rc 0) 00000100:00100000:3.0:1790945559.063649:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:9988:x1877942254744192:12345-192.168.202.48@tcp:101:bash.0 Request processed in 216us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945559.063695:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00100000:0.0:1790945559.067265:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.067601:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254744320 00000100:00100000:2.0:1790945559.067611:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254744320 00002000:00010000:2.0:1790945559.067652:0:6676:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1790945559.067859:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb88135f100 with x1877942254744320 ext(0->18446744073709551615) 00002000:00010000:2.0:1790945559.067872:0:6676:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb88135f100. 00000100:00100000:2.0:1790945559.067904:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:2.0:1790945559.067916:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2373:x1877942254744320:12345-192.168.202.48@tcp:10:bash.0 00002000:00010000:2.0:1790945559.071955:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790945559.071964:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790945557 -> 1790945559 00002000:00010000:2.0:1790945559.071967:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1790945555 -> 1790945555 00002000:00010000:2.0:1790945559.071981:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790945557 -> 1790945559 00002000:00010000:2.0:1790945559.071984:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790945559.072057:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2373:x1877942254744320:12345-192.168.202.48@tcp:10:bash.0 Request processed in 4139us (4795us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790945559.072070:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1 00002000:00010000:2.0:1790945559.072076:0:6676:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1790945559.072079:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb88135f100 with x1877942254744320 ext(0->18446744073709551615) 00002000:00010000:2.0:1790945559.072086:0:6676:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb88135f100. 00000100:00100000:0.0:1790945559.191773:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945559.191902:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254744448 00000100:00100000:1.0:1790945559.191913:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254744448 00000100:00100000:1.0:1790945559.191998:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 91 00000100:00100000:1.0:1790945559.192008:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:10473:x1877942254744448:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:1.0:1790945559.192075:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f846 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192091:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f846 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192101:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f846 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192115:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f84d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192122:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f84d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192129:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f84d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192343:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f854 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192352:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192359:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790945559.192397:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192408:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f846 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192421:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f846 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192428:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f846 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192434:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945559.192438:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f846 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192446:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f846 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192458:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:1.0:1790945559.192461:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945559.192466:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f846 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192471:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f846 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192485:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f84d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192491:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f84d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192496:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f84d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192501:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945559.192520:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f84d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192527:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f84d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192534:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb843765e00) 00010000:00010000:1.0:1790945559.192537:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945559.192539:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f84d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192544:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f84d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192561:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192567:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f854 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192572:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f854 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192576:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133c00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945559.192579:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f854 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192584:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f854 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192591:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb85a4d2300) 00010000:00010000:1.0:1790945559.192593:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945559.192602:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f854 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.192608:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f854 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945559.192728:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:10473:x1877942254744448:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 719us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945559.192738:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 91 00000100:00100000:3.0:1790945559.247158:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.247431:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254744704 00000100:00100000:2.0:1790945559.247441:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254744704 00000100:00100000:2.0:1790945559.247505:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 92 00000100:00100000:2.0:1790945559.247515:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:10476:x1877942254744704:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945559.247537:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945559.247559:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f85b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8256 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.247637:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f862 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.247651:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f862 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.247693:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f862 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.247715:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f869 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.247722:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.247749:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248030:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248040:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248047:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945559.248129:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790945559.248439:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f862 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248447:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f862 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248454:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f862 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248460:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945559.248464:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f862 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248471:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f862 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248688:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:2.0:1790945559.248692:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945559.248709:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f862 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248720:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f862 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248735:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248741:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f869 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248746:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248752:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434aea00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945559.248754:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248760:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f869 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248768:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb845042e00) 00010000:00010000:2.0:1790945559.248771:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945559.248774:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f869 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248780:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f869 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248821:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f85b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8256 expref: 30 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248858:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8256 expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.248865:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb85a4d2300) 00010000:00010000:2.0:1790945559.248868:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790945559.248870:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434ae000, rc 0) 00000100:00100000:2.0:1790945559.249543:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:10476:x1877942254744704:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2027us (2392us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1790945559.249558:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 92 00000100:00100000:0.0:1790945559.254448:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945559.254564:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254744832 00000100:00100000:1.0:1790945559.254573:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254744832 00000100:00100000:1.0:1790945559.254627:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 93 00000100:00100000:1.0:1790945559.254636:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:10476:x1877942254744832:12345-192.168.202.48@tcp:54:lfs.0 00010000:00010000:1.0:1790945559.254731:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.254743:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8241 expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.254750:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.254775:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8241 expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.254785:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8241 expref: 29 pid: 5824 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945559.254796:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88165d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273639168:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945559.254899:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48d80 going to sleep for 11 seconds 00010000:00010000:1.0:1790945559.260271:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945559.263645:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88165d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273639168:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945559.263706:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945559.267712:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.267809:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254745088 00000100:00100000:2.0:1790945559.267819:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254745088 00000100:00100000:2.0:1790945559.267881:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 22 00000100:00100000:2.0:1790945559.267889:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:5613:x1877942254745088:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790945559.268243:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+31:5613:x1877942254745088:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 353us (540us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1790945559.268251:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 22 00000100:00100000:0.0:1790945559.276850:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.276933:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254745216 00000100:00100000:2.0:1790945559.276942:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254745216 00010000:00010000:2.0:1790945559.276983:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8241 expref: 31 pid: 5824 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945559.277034:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 48 00000100:00100000:2.0:1790945559.277041:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+31:2372:x1877942254745216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945559.277053:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945559.277243:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8241 expref: 31 pid: 5824 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.277257:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8241 expref: 31 pid: 5824 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.277279:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f823 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8241 expref: 31 pid: 5824 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.277296:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb85a4d2300) 00010000:00010000:2.0:1790945559.277301:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.277308:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.277313:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.277369:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945559.277423:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:2372:x1877942254745216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 380us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945559.277430:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 48 00010000:00010000:1.0:1790945559.280314:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.280331:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.280367:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.280375:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.280383:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.280390:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133c00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945559.280394:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.280402:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.280418:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb85a4d2300) 00010000:00010000:1.0:1790945559.280421:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790945559.280425:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.280448:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54f87e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945559.280617:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:10476:x1877942254744832:12345-192.168.202.48@tcp:54:lfs.0 Request processed in 25976us (26179us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945559.280628:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 93 00000100:00100000:0.0:1790945559.284121:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.284297:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254745472 00000100:00100000:2.0:1790945559.284308:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254745472 00000100:00100000:3.0:1790945559.284736:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 23 00000100:00100000:3.0:1790945559.284754:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:10476:x1877942254745472:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1790945559.285004:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:10476:x1877942254745472:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 252us (988us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1790945559.285012:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 23 00000100:00100000:0.0:1790945559.393811:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.393937:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254745728 00000100:00100000:2.0:1790945559.393948:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254745728 00000100:00100000:2.0:1790945559.394048:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 94 00000100:00100000:2.0:1790945559.394070:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:10487:x1877942254745728:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1790945559.394097:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945559.394130:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f885 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c825d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394213:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f88c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394228:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f88c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394239:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f88c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394255:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394262:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394268:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394511:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f89a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394521:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f89a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394527:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f89a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945559.394537:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1790945559.394625:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f88c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394643:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f88c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394649:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f88c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394697:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434afa00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945559.394702:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f88c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394709:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f88c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394721:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:2.0:1790945559.394725:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945559.394729:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f88c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394735:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f88c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394748:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394753:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f893 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394758:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394763:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434aea00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945559.394773:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394779:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f893 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394786:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb845042e00) 00010000:00010000:2.0:1790945559.394789:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945559.394791:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f893 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394796:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f893 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394851:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f885 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c825d expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394865:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f89a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c825d expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.394872:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb85a4d2300) 00010000:00010000:2.0:1790945559.394875:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945559.394877:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434af400, rc 0) 00000100:00100000:2.0:1790945559.394941:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+32:10487:x1877942254745728:12345-192.168.202.48@tcp:101:cat.0 Request processed in 883us (1140us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1790945559.394949:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 94 00000100:00100000:0.0:1790945559.401929:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945559.402009:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254745984 00000100:00100000:3.0:1790945559.402020:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254745984 00000100:00100000:3.0:1790945559.402081:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 24 00000100:00100000:3.0:1790945559.402092:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+32:10487:x1877942254745984:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1790945559.402522:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:10487:x1877942254745984:12345-192.168.202.48@tcp:35:cat.0 Request processed in 430us (611us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1790945559.402531:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 24 00000100:00100000:0.0:1790945559.430964:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.431867:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254746240 00000100:00100000:2.0:1790945559.431879:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254746240 00000100:00100000:0.0:1790945559.433286:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 95 00000100:00100000:0.0:1790945559.433301:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:10488:x1877942254746240:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:0.0:1790945559.433363:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790945559.433390:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f89a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c825d expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.433412:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f870 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8256 expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.433444:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f838 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8248 expref: 31 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.433458:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb85a4d2300) 00010000:00010000:0.0:1790945559.433469:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945559.433489:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f8a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.433502:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f8a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.433511:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f8a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.433525:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f8af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.433532:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f8af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.433539:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f8af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.433863:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f8b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.433873:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.433880:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790945559.434730:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1790945559.434741:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 305230083502ns, next at 306230080628ns, rc = 0 00010000:00010000:0.0:1790945559.434803:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f8bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.434815:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f8bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.434823:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f8bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.434842:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f8bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.434848:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f8bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.434854:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f8bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.434884:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790945559.434905:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.434912:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f8b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.435158:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945559.435185:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f8bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.435193:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d200 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945559.435197:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f8bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.435205:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f8bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.435215:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8300) 00010000:00010000:3.0:1790945559.435218:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790945559.435221:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f8bd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.435226:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54f8bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.435240:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945559.435242:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945559.435243:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945559.436763:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f8b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.436777:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945559.436794:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f8b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.436802:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f8b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.436815:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bb8510c8300) 00010000:00010000:0.0:1790945559.436818:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790945559.436822:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f8b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.436841:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54f8b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.436871:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f8a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.436878:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f8a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.436884:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f8a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.436889:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945559.436892:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f8a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.436898:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f8a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.436905:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:0.0:1790945559.436908:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945559.437271:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f8a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945559.437281:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54f8a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945559.437294:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006e2e37e4 reply state 000000005c2e674d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f8af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945559.437304:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945559.437501:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+32:10488:x1877942254746240:12345-192.168.202.48@tcp:36:rm.0 Request processed in 4199us (6542us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1790945559.437511:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 95 00010000:00010000:3.0:1790945559.442580:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f8af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.442598:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f8af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.442606:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f8af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.442612:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945559.442618:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f8af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.442640:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f8af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.442694:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb8510c8400) 00010000:00010000:3.0:1790945559.442697:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945559.442703:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f8af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.442709:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54f8af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945559.540920:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945559.541228:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254746496 00000100:00100000:1.0:1790945559.541239:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254746496 00000100:00100000:1.0:1790945559.541299:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 96 00000100:00100000:1.0:1790945559.541309:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+31:10494:x1877942254746496:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:1.0:1790945559.541342:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945559.541363:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f8c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8264 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.541485:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f8cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.541500:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f8cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.541511:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f8cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.541526:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f8d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.541533:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.541556:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790945559.542863:0:7211:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1790945559.543184:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f8d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.543198:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.543207:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.543243:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f8cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.543251:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f8cb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.543258:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f8cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.543264:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945559.543268:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f8cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.543276:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f8cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.543287:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:1.0:1790945559.543290:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945559.543304:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f8cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.543311:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54f8cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790945559.543833:0:7211:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007a391d58 reply state 00000000ab7c10b1 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945559.543845:0:7211:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790945559.543883:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54f8c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8264 expref: 34 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.543899:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8264 expref: 33 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.543907:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:1.0:1790945559.543910:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945559.543912:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133600, rc 0) 00000100:00100000:1.0:1790945559.544144:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+34:10494:x1877942254746496:12345-192.168.202.48@tcp:101:bash.0 Request processed in 2833us (3232us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1790945559.544153:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 96 00000100:00100000:0.0:1790945559.553854:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945559.553954:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254746624 00000100:00100000:1.0:1790945559.553965:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254746624 00000100:00100000:1.0:1790945559.554045:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 34 00000100:00100000:1.0:1790945559.554065:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2372:x1877942254746624:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:1.0:1790945559.554085:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945559.554108:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a54f8e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c826b expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790945559.554156:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945559.554179:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=305s v=(0 0) 00010000:00010000:1.0:1790945559.554184:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945559.554194:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a54f8e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c826b expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.554214:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a54f8e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c826b expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.554228:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132c00, rc 0) 00000100:00100000:1.0:1790945559.554283:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254746624:12345-192.168.202.48@tcp:101:bash.0 Request processed in 228us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945559.554290:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 34 00000100:00080000:0.0:1790945559.555294:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790945559.556957:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.556972:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f8d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.556980:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f8d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.556985:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133a00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945559.556990:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f8d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.556998:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f8d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.557026:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb843765e00) 00010000:00010000:3.0:1790945559.557030:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945559.557034:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f8d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.557876:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54f8d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945559.558476:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.568728:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254746752 00000100:00100000:2.0:1790945559.568743:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254746752 00000100:00100000:2.0:1790945559.568845:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 35 00000100:00100000:2.0:1790945559.568856:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:10494:x1877942254746752:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:2.0:1790945559.568875:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945559.568893:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8272 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.568924:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a54f8e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c826b expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.568934:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945559.568938:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945559.568944:0:6670:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.568979:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a54f8e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c826b expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.568994:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a54f8e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c826b expref: 7 pid: 6673 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945559.570304:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1877942273639296:192.168.202.48@tcp:104: 00000100:00100000:2.0:1790945559.570412:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842f4f540 going to sleep for 11 seconds 00000100:00100000:1.0:1790945559.578098:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.578377:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1877942273639296:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945559.578413:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.578455:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434ae400, rc 0) 00000100:00100000:2.0:1790945559.578520:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:10494:x1877942254746752:12345-192.168.202.48@tcp:101:bash.0 Request processed in 9665us (20047us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945559.578529:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 35 00000100:00100000:3.0:1790945559.578804:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254746880 00000100:00100000:3.0:1790945559.578812:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254746880 00010000:00010000:2.0:1790945559.579009:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a54f8e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c826b expref: 7 pid: 6673 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945559.579046:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 49 00000100:00100000:2.0:1790945559.579136:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2372:x1877942254746880:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945559.579157:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945559.579181:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a54f8e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c826b expref: 7 pid: 6673 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.579194:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a54f8e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c826b expref: 7 pid: 6673 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.579217:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a54f8e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c826b expref: 7 pid: 6673 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.579231:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945559.579236:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945559.579244:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.579268:0:8440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.579304:0:8440:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945559.579387:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8440:1877942273639424:192.168.202.48@tcp:105: 00000100:00100000:2.0:1790945559.579505:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842f4f540 going to sleep for 11 seconds 00000100:00100000:1.0:1790945559.597511:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945559.598033:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254747136 00000100:00100000:0.0:1790945559.598044:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254747136 00000100:00100000:0.0:1790945559.598110:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 25 00000100:00100000:0.0:1790945559.598120:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:10494:x1877942254747136:12345-192.168.202.48@tcp:35:bash.0 00000001:00080000:0.0:1790945559.598625:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967377 00000100:00100000:0.0:1790945559.598773:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:10494:x1877942254747136:12345-192.168.202.48@tcp:35:bash.0 Request processed in 653us (1268us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1790945559.598781:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 25 00000020:00080000:0.0:1790945559.598786:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790945559.601947:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8440:1877942273639424:192.168.202.48@tcp:105: 00010000:00010000:2.0:1790945559.601974:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945559.602035:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254746880:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 22980us (23945us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945559.602047:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 49 00000100:00100000:1.0:1790945559.903003:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.903165:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254747264 00000100:00100000:2.0:1790945559.903176:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254747264 00000100:00100000:2.0:1790945559.903246:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 97 00000100:00100000:2.0:1790945559.903256:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:10510:x1877942254747264:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945559.903281:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945559.903301:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f8f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8279 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.903365:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f8fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.903381:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.903407:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945559.903445:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790945559.903449:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945559.903468:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.903489:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f8f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8279 expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.903508:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f8fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8279 expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.903516:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:2.0:1790945559.903519:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945559.903523:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434afa00, rc 0) 00000100:00100000:2.0:1790945559.906512:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:10510:x1877942254747264:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3245us (3507us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945559.906527:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 97 00000100:00100000:0.0:1790945559.920172:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.920271:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254747520 00000100:00100000:2.0:1790945559.920282:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254747520 00000100:00100000:2.0:1790945559.920346:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 98 00000100:00100000:2.0:1790945559.920358:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:10510:x1877942254747520:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945559.920380:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945559.920401:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f903 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8280 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.920524:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f90a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.920538:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f90a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.920563:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f90a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945559.920586:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790945559.920753:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f903 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8280 expref: 39 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.920772:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f90a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8280 expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.920780:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:2.0:1790945559.920784:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945559.920787:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434ae000, rc 0) 00000100:00100000:2.0:1790945559.920858:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+38:10510:x1877942254747520:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 502us (697us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1790945559.920865:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 98 00000100:00100000:3.0:1790945559.926407:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.932380:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254747776 00000100:00100000:2.0:1790945559.932396:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254747776 00000100:00100000:2.0:1790945559.932522:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 99 00000100:00100000:2.0:1790945559.932533:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+38:10510:x1877942254747776:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945559.932560:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945559.932608:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f918 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8287 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.932732:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f91f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.932747:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f91f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.932758:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f91f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945559.932770:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790945559.932896:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f918 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8287 expref: 41 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.932916:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f91f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8287 expref: 40 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.932925:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:2.0:1790945559.932928:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790945559.932931:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434af400, rc 0) 00000100:00100000:2.0:1790945559.933025:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+40:10510:x1877942254747776:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 492us (6625us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1790945559.933032:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 99 00000100:00100000:3.0:1790945559.939017:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945559.939395:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254747904 00000100:00100000:1.0:1790945559.939406:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254747904 00000100:00100000:1.0:1790945559.939475:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00100000:1.0:1790945559.939485:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254747904:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1790945559.939533:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.939865:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.939895:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945559.939899:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790945559.939904:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.939945:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.940149:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 6 pid: 6670 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945559.940166:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88165df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1877942273639552:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945559.940338:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945559.950836:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945559.950901:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.950981:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88165df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1877942273639552:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945559.951008:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945559.951176:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254748160 00000100:00100000:3.0:1790945559.951184:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254748160 00002000:00100000:3.0:1790945559.951225:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9bb87fa05880 x1877942254748160/t0(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:255/0 lens 504/0 e 0 to 0 dl 1790945570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945559.951236:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb87fa05880 with x1877942254748160 ext(0->8) 00010000:00010000:3.0:1790945559.951243:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 7 pid: 6670 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.951257:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 7 pid: 6670 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945559.951265:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bb87fa05880 00000100:00100000:3.0:1790945559.951297:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:3.0:1790945559.951305:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2373:x1877942254748160:12345-192.168.202.48@tcp:4:lfs.0 00000100:00100000:1.0:1790945559.951798:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254748032 00000100:00100000:1.0:1790945559.951804:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254748032 00000100:00100000:1.0:1790945559.951859:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:1.0:1790945559.951868:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+40:2370:x1877942254748032:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945559.951880:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945559.951901:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f90a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8280 expref: 40 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945559.951918:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:1.0:1790945559.951923:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945559.951974:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+39:2370:x1877942254748032:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 108us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945559.951991:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:3.0:1790945559.952295:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2373:x1877942254748160:12345-192.168.202.48@tcp:4:lfs.0 Request processed in 990us (1391us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790945559.952303:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1 00002000:00100000:3.0:1790945559.952311:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9bb87fa05880 x1877942254748160/t4294967302(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:255/0 lens 504/448 e 0 to 0 dl 1790945570 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945559.952332:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb87fa05880 with x1877942254748160 ext(0->8) 00010000:00010000:3.0:1790945559.952340:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 9 pid: 6670 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.952354:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 9 pid: 6670 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945559.952362:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bb87fa05880 00000100:00100000:1.0:1790945559.955544:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.955788:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254748288 00000100:00100000:2.0:1790945559.955800:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254748288 00010000:00010000:2.0:1790945559.955851:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 9 pid: 6670 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945559.955890:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 50 00000100:00100000:2.0:1790945559.955900:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2371:x1877942254748288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945559.955916:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790945559.955935:0:5809:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790945559.955939:0:5809:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790945560 00002000:00010000:2.0:1790945559.955941:0:5809:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790945560 00002000:00010000:2.0:1790945559.955943:0:5809:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790945560 00010000:00010000:2.0:1790945559.955950:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 9 pid: 6670 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.955976:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 9 pid: 6670 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.956001:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54f8ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8272 expref: 9 pid: 6670 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.956018:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945559.956023:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945559.956029:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.956189:0:5809:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.956232:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945559.956400:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2371:x1877942254748288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 500us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945559.956410:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 50 00010000:00010000:3.0:1790945559.956531:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.956542:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.956591:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.956601:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.956610:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.956617:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133200 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945559.956621:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.956640:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.956685:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945559.956694:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5d9ab7e/0xc5cf2c2a6a54f92d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945559.956761:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2372:x1877942254747904:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 17277us (17761us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945559.956769:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00100000:3.0:1790945559.968255:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.968459:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254748544 00000100:00100000:2.0:1790945559.968471:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254748544 00000100:00100000:2.0:1790945559.968528:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 26 00000100:00100000:2.0:1790945559.968537:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8477f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+39:10510:x1877942254748544:12345-192.168.202.48@tcp:35:lfs.0 00000004:00010000:2.0:1790945559.968598:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f91f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8287 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945559.968909:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1790945559.968967:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1790945559.969398:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:2.0:1790945559.969444:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.969459:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f8d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8264 expref: 43 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.969468:0:5826:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.969500:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8264 expref: 43 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945559.969527:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f8d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8264 expref: 43 pid: 7211 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945559.969541:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716bea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5826:1877942273639680:192.168.202.48@tcp:104: 00000100:00100000:2.0:1790945559.969625:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842f4f600 going to sleep for 11 seconds 00000100:00100000:3.0:1790945559.980007:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945559.980098:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716bea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5826:1877942273639680:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945559.980125:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945560.000257:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254748672 00000100:00100000:1.0:1790945560.000273:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254748672 00010000:00010000:1.0:1790945560.000336:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f8d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8264 expref: 44 pid: 7211 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945560.000380:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 51 00000100:00100000:1.0:1790945560.000391:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+44:2372:x1877942254748672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945560.000407:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945560.000415:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f8d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8264 expref: 44 pid: 7211 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.000429:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8264 expref: 44 pid: 7211 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.000450:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f8d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8264 expref: 44 pid: 7211 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.000467:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:1.0:1790945560.000472:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.000481:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.000488:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.000530:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945560.004097:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+43:2372:x1877942254748672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3693us (24089us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945560.004114:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 51 00010000:00010000:0.0:1790945560.006223:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.006255:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790945560.006389:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1790945560.007086:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1790945560.007215:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fa04380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877942273639808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790945560.007290:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945560.007382:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881032d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790945560.011942:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273639808 00000100:00100000:1.0:1790945560.011968:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273639808 00000100:00100000:1.0:1790945560.012069:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790945560.012081:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5826:x1877942273639808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790945560.012217:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5826:x1877942273639808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 139us (4927us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945560.012226:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790945560.012285:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fa04380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877942273639808:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1790945560.012908:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1790945560.013265:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1790945560.013350:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88165f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877942273639936:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790945560.013403:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945560.013441:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842cbe300 going to sleep for 11 seconds 00000100:00100000:0.0:1790945560.013505:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273639936 00000100:00100000:0.0:1790945560.013511:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273639936 00000100:00100000:0.0:1790945560.013563:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790945560.013578:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5826:x1877942273639936:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790945560.013774:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5826:x1877942273639936:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 196us (369us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790945560.013782:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790945560.014206:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88165f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877942273639936:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790945560.014266:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1790945560.014307:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.014318:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.014326:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.014345:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434aea00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945560.014350:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.014358:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.014374:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:1.0:1790945560.014377:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790945560.014382:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.014388:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f934 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790945560.014563:0:5826:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790945560.014942:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1790945560.015082:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 305810423589ns, next at 306810294965ns, rc = 0 00000001:00080000:1.0:1790945560.015094:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1790945560.015136:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:1.0:1790945560.015140:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790945560.015148:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54f91f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8287 expref: 47 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945560.015302:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8477f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+46:10510:x1877942254748544:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 46765us (47057us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1790945560.015316:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 26 00000020:00080000:1.0:1790945560.015321:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790945560.017907:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945560.017943:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254748800 00000100:00100000:3.0:1790945560.017953:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254748800 00000100:00080000:3.0:1790945560.018710:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945560.018761:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 100 00000100:00100000:3.0:1790945560.018772:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+46:10510:x1877942254748800:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945560.018795:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945560.018817:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54f93b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c828e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.018892:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54f93b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c828e expref: 47 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.018922:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54f93b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c828e expref: 47 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.018944:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:3.0:1790945560.018947:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945560.018951:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030e00, rc 0) 00000100:00100000:3.0:1790945560.019196:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+47:10510:x1877942254748800:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 424us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945560.019203:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 100 00000100:00100000:3.0:1790945560.024141:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945560.025111:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254749056 00000100:00100000:0.0:1790945560.025123:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254749056 00000100:00100000:2.0:1790945560.025319:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 27 00000100:00100000:2.0:1790945560.025331:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+47:10510:x1877942254749056:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1790945560.025618:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+48:10510:x1877942254749056:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 287us (1485us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1790945560.025627:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 27 00000100:00100000:2.0:1790945560.139073:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945560.139206:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254749184 00000100:00100000:0.0:1790945560.139218:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254749184 00000100:00100000:0.0:1790945560.139278:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 101 00000100:00100000:0.0:1790945560.139289:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+48:10520:x1877942254749184:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:0.0:1790945560.139372:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f942 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.139392:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f942 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.139422:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f942 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.139440:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f949 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.139447:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.139453:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.139561:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f950 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.139571:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.139578:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945560.139620:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.139632:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f942 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.139639:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f942 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141756:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f942 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141795:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945560.141800:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f942 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141809:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f942 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141833:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:0.0:1790945560.141837:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945560.141842:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f942 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141848:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f942 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141866:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141870:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f949 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141874:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f949 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141877:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945560.141879:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f949 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141882:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f949 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141895:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb8510c8300) 00010000:00010000:0.0:1790945560.141896:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945560.141898:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f949 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141902:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f949 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141915:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141918:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f950 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141922:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f950 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141925:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945560.141926:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f950 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141930:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f950 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141933:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:0.0:1790945560.141934:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945560.141936:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f950 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.141939:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f950 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945560.142050:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+48:10520:x1877942254749184:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 2760us (2984us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945560.142059:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 101 00000100:00100000:1.0:1790945560.222309:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945560.224872:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254749440 00000100:00100000:3.0:1790945560.224898:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254749440 00000100:00100000:3.0:1790945560.225007:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 102 00000100:00100000:3.0:1790945560.225021:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+48:10523:x1877942254749440:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945560.225053:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945560.225094:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030600/0xc5cf2c2a6a54f957 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8295 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.225198:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54f95e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.225218:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54f95e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.225235:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54f95e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.225281:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f965 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.225290:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.225298:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.225490:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f96c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.225500:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f96c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.225507:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f96c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945560.225519:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790945560.226193:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54f95e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226208:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54f95e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226216:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54f95e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226223:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945560.226230:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54f95e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226254:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54f95e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226271:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:3.0:1790945560.226274:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945560.226280:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54f95e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226286:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54f95e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226540:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226547:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f965 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226553:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226559:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031c00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945560.226562:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226568:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f965 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226576:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb85a4d2800) 00010000:00010000:3.0:1790945560.226579:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945560.226582:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f965 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226600:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54f965 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226790:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030600/0xc5cf2c2a6a54f957 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8295 expref: 51 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226810:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f96c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8295 expref: 50 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.226827:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:3.0:1790945560.226831:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945560.226834:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030400, rc 0) 00000100:00100000:3.0:1790945560.226951:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+50:10523:x1877942254749440:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1933us (4652us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1790945560.226961:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 102 00000100:00100000:3.0:1790945560.231583:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945560.231710:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254749568 00000100:00100000:2.0:1790945560.231725:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254749568 00000100:00100000:2.0:1790945560.231797:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 103 00000100:00100000:2.0:1790945560.231810:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+50:10523:x1877942254749568:12345-192.168.202.48@tcp:54:lfs.0 00010000:00010000:2.0:1790945560.231911:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f97a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.231933:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f97a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.231974:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f97a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.232011:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f97a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.232019:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f97a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.232026:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f97a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.232032:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434aea00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945560.232038:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f97a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.232047:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f97a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.232062:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:2.0:1790945560.232065:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790945560.232070:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f97a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.232077:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54f97a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945560.232185:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+50:10523:x1877942254749568:12345-192.168.202.48@tcp:54:lfs.0 Request processed in 376us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945560.232194:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 103 00000100:00100000:2.0:1790945560.240544:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945560.240927:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254749824 00000100:00100000:1.0:1790945560.240940:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254749824 00000100:00100000:1.0:1790945560.241043:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 28 00000100:00100000:1.0:1790945560.241055:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+50:10523:x1877942254749824:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:1.0:1790945560.241400:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+51:10523:x1877942254749824:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 345us (869us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1790945560.241409:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 28 00010000:00010000:1.0:1790945560.284482:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945560.347954:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273640064:0@lo:400:kworker.0 00000100:00100000:1.0:1790945560.348021:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273640192:0@lo:400:kworker.0 00000100:00100000:2.0:1790945560.348104:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87397f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273640448:0@lo:400:kworker.0 00000100:00100000:3.0:1790945560.348243:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87397ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273640320:0@lo:400:kworker.0 00000100:00100000:1.0:1790945560.359322:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945560.359426:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273640704:0@lo:400:kworker.0 00000100:00100000:1.0:1790945560.359478:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945560.359580:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273640192 00000100:00100000:1.0:1790945560.359591:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273640192 00000100:00100000:1.0:1790945560.359671:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790945560.359683:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273640192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945560.359759:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273640192:12345-0@lo:400:kworker.0 Request processed in 77us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945560.359768:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790945560.359838:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273640192:0@lo:400:kworker.0 00000100:00100000:1.0:1790945560.359900:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273640704 00000100:00100000:1.0:1790945560.359904:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273640704 00000100:00100000:1.0:1790945560.362786:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790945560.362829:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3294:x1877942273640704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945560.364527:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945560.369930:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273640064 00000100:00100000:0.0:1790945560.369953:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273640064 00000100:00100000:0.0:1790945560.370059:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1790945560.370071:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273640064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945560.370185:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3293:x1877942273640064:12345-0@lo:400:kworker.0 Request processed in 116us (5667us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945560.370194:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1790945560.370284:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87acfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273640064:0@lo:400:kworker.0 00000100:00100000:0.0:1790945560.370325:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87397fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273640576:0@lo:400:kworker.0 00000100:00100000:0.0:1790945560.370371:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945560.370414:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273640576 00000100:00100000:0.0:1790945560.370418:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273640576 00000100:00100000:0.0:1790945560.370458:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790945560.370465:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273640576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945560.370503:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273640576:12345-0@lo:400:kworker.0 Request processed in 39us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945560.370510:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790945560.370543:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87397fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273640576:0@lo:400:kworker.0 00000100:00100000:0.0:1790945560.370602:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273640704:0@lo:400:kworker.0 00000100:00080000:0.0:1790945560.370642:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790945560.370648:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790945560.370786:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945560.370829:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273640448 00000100:00100000:2.0:1790945560.370833:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273640448 00000100:00100000:2.0:1790945560.370870:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790945560.370880:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3292:x1877942273640448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945560.370931:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3292:x1877942273640448:12345-0@lo:400:kworker.0 Request processed in 41us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945560.370940:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790945560.375049:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945560.375176:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273640320 00000100:00100000:3.0:1790945560.375190:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273640320 00000100:00100000:3.0:1790945560.375268:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790945560.375280:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273640320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945560.375357:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273640320:12345-0@lo:400:kworker.0 Request processed in 80us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945560.375366:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1790945560.375392:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945560.375452:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87397ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273640320:0@lo:400:kworker.0 00000100:00100000:3.0:1790945560.375530:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87397f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273640448:0@lo:400:kworker.0 00000100:00100000:1.0:1790945560.375771:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3294:x1877942273640704:12345-0@lo:400:kworker.0 Request processed in 12967us (16287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945560.375790:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790945560.381166:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945560.382272:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254750080 00000100:00100000:0.0:1790945560.382290:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254750080 00000100:00100000:0.0:1790945560.382387:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 104 00000100:00100000:0.0:1790945560.382401:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+51:10533:x1877942254750080:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1790945560.382435:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945560.382439:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790945560.382474:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f8fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8279 expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.382499:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:0.0:1790945560.382505:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945560.382521:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f981 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c829c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.382654:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.383177:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.383191:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945560.383208:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790945560.383388:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f981 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c829c expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.383409:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c829c expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.383436:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:0.0:1790945560.383440:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945560.383443:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d400, rc 0) 00000100:00100000:0.0:1790945560.383541:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+52:10533:x1877942254750080:12345-192.168.202.48@tcp:101:bash.0 Request processed in 1143us (2391us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1790945560.383549:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 104 00000100:00100000:3.0:1790945560.396938:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945560.397127:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254750336 00000100:00100000:1.0:1790945560.397140:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254750336 00000100:00100000:1.0:1790945560.397219:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 105 00000100:00100000:1.0:1790945560.397231:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+52:10533:x1877942254750336:12345-192.168.202.48@tcp:36:bash.0 00010000:00010000:1.0:1790945560.397325:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1790945560.397357:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54f988 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c829c expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.397455:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54f96c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8295 expref: 51 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.397469:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:1.0:1790945560.397477:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790945560.399634:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f996 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.399696:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f996 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.399713:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f996 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945560.399834:0:7211:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:1.0:1790945560.399877:0:7211:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d488c60d reply state 00000000ad590e0c transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f996 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945560.399889:0:7211:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945560.401312:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+53:10533:x1877942254750336:12345-192.168.202.48@tcp:36:bash.0 Request processed in 4071us (4389us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1790945560.401328:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 105 00000020:00080000:0.0:1790945560.401336:0:7211:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790945560.408116:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f996 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.408142:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f996 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.408150:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f996 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.408158:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945560.408164:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f996 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.408174:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f996 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.408208:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:3.0:1790945560.408212:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945560.408218:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f996 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.408225:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54f996 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945560.418210:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945560.418323:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254750464 00000100:00100000:0.0:1790945560.418338:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254750464 00000100:00100000:0.0:1790945560.418420:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 106 00000100:00100000:0.0:1790945560.418433:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+52:10533:x1877942254750464:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1790945560.418469:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945560.418498:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f99d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82a3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.418618:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f9a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.418638:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.418652:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945560.418762:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790945560.418767:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945560.418794:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.418841:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54f99d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82a3 expref: 54 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.418866:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82a3 expref: 53 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.418876:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:0.0:1790945560.418879:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945560.418883:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c200, rc 0) 00000100:00100000:0.0:1790945560.418971:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+53:10533:x1877942254750464:12345-192.168.202.48@tcp:101:bash.0 Request processed in 541us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945560.418988:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 106 00000100:00100000:2.0:1790945560.429643:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945560.429958:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254750720 00000100:00100000:3.0:1790945560.430138:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254750720 00000100:00100000:3.0:1790945560.430287:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 29 00000100:00100000:3.0:1790945560.430300:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+53:10533:x1877942254750720:12345-192.168.202.48@tcp:35:bash.0 00000100:00100000:3.0:1790945560.430647:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+54:10533:x1877942254750720:12345-192.168.202.48@tcp:35:bash.0 Request processed in 349us (1019us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1790945560.430702:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 29 00000100:00100000:3.0:1790945560.564795:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945560.564937:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254750848 00000100:00100000:0.0:1790945560.564951:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254750848 00000100:00100000:0.0:1790945560.565045:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 107 00000100:00100000:0.0:1790945560.565059:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+54:10539:x1877942254750848:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945560.565104:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945560.565142:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54f9ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82aa expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.565248:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f9b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.565288:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f9b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.565304:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f9b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945560.565353:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790945560.565357:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945560.565379:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f9b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.565411:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54f9ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82aa expref: 56 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.565434:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f9b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82aa expref: 55 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945560.565446:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:0.0:1790945560.565449:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945560.565453:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d600, rc 0) 00000100:00100000:0.0:1790945560.565542:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:10539:x1877942254750848:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 486us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945560.565551:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 107 00000100:00100000:0.0:1790945560.571161:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945560.571251:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254750976 00000100:00100000:2.0:1790945560.571266:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254750976 00000100:00100000:2.0:1790945560.571346:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 108 00000100:00100000:2.0:1790945560.571359:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:10539:x1877942254750976:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945560.571390:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945560.571419:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f9b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82b1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571505:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f9c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571525:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f9c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571539:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f9c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571559:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f9c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571591:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571598:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571751:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f9ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571761:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f9ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571769:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f9ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945560.571828:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790945560.571833:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945560.571859:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f9ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571872:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f9ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571881:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f9c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571889:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f9c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571896:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f9c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571913:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945560.571918:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f9c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571927:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f9c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571943:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:2.0:1790945560.571947:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945560.571952:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f9c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571960:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54f9c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571977:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571983:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f9c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571990:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f9c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.571996:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434ae400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945560.571998:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f9c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.572004:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f9c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.572026:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb845042e00) 00010000:00010000:2.0:1790945560.572028:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945560.572031:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f9c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.572038:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54f9c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.572076:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54f9b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82b1 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.572102:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f9ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82b1 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.572115:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:2.0:1790945560.572117:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945560.572120:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434afa00, rc 0) 00000100:00100000:2.0:1790945560.572206:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:10539:x1877942254750976:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 849us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945560.572215:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 108 00000100:00100000:2.0:1790945560.576457:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945560.576587:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254751360 00000100:00100000:1.0:1790945560.576620:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254751360 00000100:00100000:1.0:1790945560.576749:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:1.0:1790945560.576762:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:2371:x1877942254751360:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945560.576783:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945560.576833:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54f9ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82b1 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.576862:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:1.0:1790945560.576869:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945560.576943:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:2371:x1877942254751360:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 183us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945560.576952:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:3.0:1790945560.577021:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945560.577646:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254751232 00000100:00100000:1.0:1790945560.577682:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254751232 00000100:00100000:1.0:1790945560.577733:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 109 00000100:00100000:1.0:1790945560.577742:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:10539:x1877942254751232:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1790945560.577765:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945560.577787:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f9d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82b8 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.577925:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.577942:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f9a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82a3 expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.577953:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.578012:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82a3 expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.578402:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f9a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82a3 expref: 56 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945560.578421:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87397dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877942273640832:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945560.578523:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb851faca80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945560.593219:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945560.593342:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254751488 00000100:00100000:2.0:1790945560.593356:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254751488 00010000:00010000:2.0:1790945560.593409:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f9a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82a3 expref: 57 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945560.593467:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 52 00000100:00100000:2.0:1790945560.593478:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:2373:x1877942254751488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945560.593520:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945560.593529:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f9a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82a3 expref: 57 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.593545:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f9a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82a3 expref: 57 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.593574:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:2.0:1790945560.593581:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.593593:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.593602:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945560.593626:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945560.593754:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:2373:x1877942254751488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 277us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945560.593765:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 52 00010000:00010000:1.0:1790945560.593905:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54f9a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82a3 expref: 56 pid: 5824 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945560.593928:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87397dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877942273640832:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945560.593956:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.593966:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.593973:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945560.593997:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790945560.594338:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f9d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82b8 expref: 57 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.594360:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82b8 expref: 56 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.594381:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:1.0:1790945560.594385:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790945560.594388:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132a00, rc 0) 00000100:00100000:1.0:1790945560.594427:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:10539:x1877942254751232:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 16686us (17407us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1790945560.594435:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 109 00000100:00100000:2.0:1790945560.601980:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945560.602155:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254751744 00000100:00100000:1.0:1790945560.602169:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254751744 00000100:00100000:1.0:1790945560.602254:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:1.0:1790945560.602267:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:10539:x1877942254751744:12345-192.168.202.48@tcp:103:lfs.0 00010000:00010000:1.0:1790945560.602289:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945560.602322:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54f93b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c828e expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945560.602346:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:1.0:1790945560.602353:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945560.602431:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:10539:x1877942254751744:12345-192.168.202.48@tcp:103:lfs.0 Request processed in 166us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945560.602440:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:0.0:1790945560.607896:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945560.608000:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254751872 00000100:00100000:3.0:1790945560.608014:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254751872 00000100:00100000:3.0:1790945560.608125:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 110 00000100:00100000:3.0:1790945560.608139:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:10539:x1877942254751872:12345-192.168.202.48@tcp:58:lfs.0 00010000:00010000:3.0:1790945560.608315:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54f9ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.608338:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54f9ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.608351:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54f9ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790945560.608604:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1790945560.608752:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:10539:x1877942254751872:12345-192.168.202.48@tcp:58:lfs.0 Request processed in 616us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945560.608762:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 110 00000100:00100000:0.0:1790945560.612561:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945560.612722:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254752000 00000100:00100000:3.0:1790945560.612737:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254752000 00000100:00100000:3.0:1790945560.612824:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 111 00000100:00100000:3.0:1790945560.612837:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:10539:x1877942254752000:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945560.612891:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945560.612920:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030600/0xc5cf2c2a6a54f9f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82bf expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.612998:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54f9ea lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.613011:0:7211:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030600/0xc5cf2c2a6a54f9f1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82bf expref: 56 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.613035:0:7211:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54f9ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.613049:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030600/0xc5cf2c2a6a54f9f1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82bf expref: 56 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.613067:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:3.0:1790945560.613071:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945560.613074:0:7211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030600/0xc5cf2c2a6a54f9f1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82bf expref: 56 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945560.613083:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030600, rc 0) 00000100:00100000:3.0:1790945560.613170:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:10539:x1877942254752000:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 336us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945560.613178:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 111 00000004:00080000:2.0:1790945560.860217:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306655555817ns, next at 307655552104ns, rc = 0 00000100:00100000:0.0:1790945560.862195:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790945560.862264:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273640960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945560.862369:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945560.862897:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273640960 00000100:00100000:2.0:1790945560.862909:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273640960 00000100:00100000:2.0:1790945560.862996:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790945560.863008:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1877942273640960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945560.863255:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945560.863345:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1877942273640960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 339us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945560.863353:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790945560.863422:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273640960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945560.877436:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945560.877467:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273641088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945560.877563:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945560.877642:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273641088 00000100:00100000:1.0:1790945560.877653:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273641088 00000100:00100000:1.0:1790945560.877732:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790945560.877762:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3293:x1877942273641088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945560.877796:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945560.877861:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3293:x1877942273641088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945560.877869:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790945560.877929:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273641088:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1790945560.998557:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1790945560.998827:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:3.0:1790945561.308594:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790945561.627964:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945561.627977:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790945561.628067:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1790945561.628095:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790945561.628289:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8715ff480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1877942273641216:192.168.202.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790945561.628450:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85209de40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945561.634181:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945561.634319:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254752128 00000100:00100000:1.0:1790945561.634333:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254752128 00000100:00100000:1.0:1790945561.634418:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 112 00000100:00100000:1.0:1790945561.634431:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:10540:x1877942254752128:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790945561.634512:0:5823:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790945561.634689:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:10540:x1877942254752128:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 Request processed in 260us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945561.634697:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 112 00000100:00100000:2.0:1790945561.635007:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8715ff480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1877942273641216:192.168.202.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790945561.646737:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945561.648057:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254752256 00000100:00100000:1.0:1790945561.648074:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254752256 00000100:00100000:1.0:1790945561.648164:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 113 00000100:00100000:1.0:1790945561.648177:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:10540:x1877942254752256:12345-192.168.202.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790945561.648273:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f9f8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.648296:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.648310:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.648490:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f9ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.648515:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f9ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.648527:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f9ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.648562:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.648572:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.648579:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945561.648625:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790945561.648629:0:5825:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790945561.648643:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.649882:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.649906:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f9f8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.649915:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.649948:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945561.649953:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.649962:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f9f8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.649977:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a900) 00010000:00010000:1.0:1790945561.649980:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945561.649985:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f9f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.649992:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54f9f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650010:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f9ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650016:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f9ff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650022:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f9ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650027:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945561.650030:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f9ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650054:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f9ff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650074:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9bb843765b00) 00010000:00010000:1.0:1790945561.650077:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945561.650080:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f9ff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650086:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54f9ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650108:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650115:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650121:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650126:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945561.650130:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650137:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650157:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:1.0:1790945561.650160:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945561.650164:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.650171:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945561.650292:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:10540:x1877942254752256:12345-192.168.202.48@tcp:34:lhsmtool_posix.0 Request processed in 2113us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945561.650303:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 113 00000100:00100000:0.0:1790945561.658573:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945561.659229:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254752512 00000100:00100000:1.0:1790945561.659245:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254752512 00000100:00100000:1.0:1790945561.659370:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 114 00000100:00100000:1.0:1790945561.659379:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:10540:x1877942254752512:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945561.659396:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945561.659412:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa0d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82c6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.659496:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.659511:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.659522:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945561.659534:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790945561.659631:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.659639:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.659646:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.659701:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945561.659706:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.659713:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.659726:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:1.0:1790945561.659729:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790945561.659734:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.659740:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.659782:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa0d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82c6 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.659792:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a900) 00010000:00010000:1.0:1790945561.659794:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790945561.659798:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa0d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82c6 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.659817:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133600, rc 0) 00000100:00100000:1.0:1790945561.659891:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:10540:x1877942254752512:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 512us (1330us total) trans 4294967398 rc 301/301 00000100:00100000:1.0:1790945561.659898:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 114 00000100:00100000:0.0:1790945561.667298:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945561.667518:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254752640 00000100:00100000:3.0:1790945561.667532:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254752640 00000100:00100000:3.0:1790945561.667613:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 115 00000100:00100000:3.0:1790945561.667626:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:10540:x1877942254752640:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790945561.667722:0:7211:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790945561.667871:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:10540:x1877942254752640:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 Request processed in 247us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945561.667880:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 115 00000100:00100000:2.0:1790945561.679026:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945561.679227:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254752896 00000100:00100000:3.0:1790945561.679244:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254752896 00000100:00100000:3.0:1790945561.679337:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 116 00000100:00100000:3.0:1790945561.679351:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:10540:x1877942254752896:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945561.679738:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945561.679742:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790945561.679781:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54f9b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82aa expref: 57 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.679817:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:3.0:1790945561.679824:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945561.679842:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fa22 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82cd expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790945561.680637:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1790945561.680949:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fa29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.680966:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fa29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.680979:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fa29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.681049:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fa22 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82cd expref: 59 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.681072:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fa29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82cd expref: 58 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.681081:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb85a4d2900) 00010000:00010000:3.0:1790945561.681084:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945561.681087:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840031600, rc 0) 00000100:00100000:3.0:1790945561.681229:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:10540:x1877942254752896:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 1880us (2213us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1790945561.681239:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 116 00000100:00100000:0.0:1790945561.699171:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945561.699297:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254753152 00000100:00100000:3.0:1790945561.699312:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254753152 00000100:00100000:3.0:1790945561.699387:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 117 00000100:00100000:3.0:1790945561.699398:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:10540:x1877942254753152:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790945561.699457:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945561.699483:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fa29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82cd expref: 58 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699523:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb85a4d2900) 00010000:00010000:3.0:1790945561.699536:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945561.699556:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fa37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699569:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fa37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699579:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fa37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699601:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fa3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1f91ccd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699620:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fa3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f91ccd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699626:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fa3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f91ccd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699881:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fa37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699890:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fa37 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699897:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fa37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699902:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031c00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945561.699906:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fa37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699922:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fa37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699931:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:3.0:1790945561.699934:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945561.699938:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fa37 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699944:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fa37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699954:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fa3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f91ccd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699960:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fa3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f91ccd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699966:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fa3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f91ccd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699971:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945561.699974:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fa3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f91ccd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699979:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fa3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f91ccd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.699985:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1f91ccd2 (ffff9bb85a4d2800) 00010000:00010000:3.0:1790945561.699987:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945561.699999:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fa3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1f91ccd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.700016:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fa3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1f91ccd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945561.700304:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:10540:x1877942254753152:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 902us (1143us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790945561.700312:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 117 00000100:00100000:0.0:1790945561.703339:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945561.703434:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254753280 00000100:00100000:1.0:1790945561.703455:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254753280 00000100:00100000:1.0:1790945561.703509:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 118 00000100:00100000:1.0:1790945561.703518:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:10540:x1877942254753280:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945561.703537:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945561.703557:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82d4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.703593:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.703606:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.703628:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.703889:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82d4 expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.703907:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82d4 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.703916:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:1.0:1790945561.703919:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790945561.703923:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132800, rc 0) 00000100:00100000:1.0:1790945561.703977:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:10540:x1877942254753280:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 460us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945561.704042:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 118 00000100:00100000:0.0:1790945561.707410:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945561.707488:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254753536 00000100:00100000:3.0:1790945561.707499:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254753536 00000100:00100000:3.0:1790945561.707557:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 119 00000100:00100000:3.0:1790945561.707567:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:10540:x1877942254753536:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790945561.707702:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.707721:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.707740:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790945561.708001:0:7211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:3.0:1790945561.708077:0:7211:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000010188382 reply state 0000000078bd536f transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945561.708087:0:7211:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945561.708198:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:10540:x1877942254753536:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 608us (773us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1790945561.708206:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 119 00010000:00010000:3.0:1790945561.712595:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.712636:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.712644:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.712651:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945561.712693:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.712702:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.712719:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:3.0:1790945561.712722:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790945561.712734:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.712741:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945561.714970:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945561.715838:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254753664 00000100:00100000:1.0:1790945561.715866:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254753664 00000100:00100000:1.0:1790945561.715917:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 120 00000100:00100000:1.0:1790945561.715927:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+59:10540:x1877942254753664:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945561.715951:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945561.715969:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82db expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.716030:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82db expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.716045:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82db expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.716065:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:1.0:1790945561.716069:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790945561.716072:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133600, rc 0) 00000100:00100000:1.0:1790945561.716135:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:10540:x1877942254753664:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 209us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945561.716143:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 120 00000100:00100000:0.0:1790945561.722019:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945561.722337:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254753792 00000100:00100000:1.0:1790945561.722347:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254753792 00000100:00100000:1.0:1790945561.722425:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 37 00000100:00100000:1.0:1790945561.722437:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2372:x1877942254753792:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790945561.722960:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945561.723141:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2372:x1877942254753792:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 Request processed in 704us (1129us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790945561.723151:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 37 00000100:00100000:0.0:1790945561.732737:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945561.733132:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254754048 00000100:00100000:1.0:1790945561.733163:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254754048 00000100:00100000:1.0:1790945561.734410:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 30 00000100:00100000:1.0:1790945561.734430:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:10540:x1877942254754048:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790945561.734818:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:10540:x1877942254754048:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 395us (2091us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1790945561.734827:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 30 00000100:00100000:2.0:1790945561.747265:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945561.747352:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254754304 00000100:00100000:3.0:1790945561.747378:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254754304 00000100:00100000:3.0:1790945561.747455:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 121 00000100:00100000:3.0:1790945561.747466:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:10540:x1877942254754304:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790945561.747766:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:10540:x1877942254754304:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 301us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945561.747775:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 121 00000100:00100000:0.0:1790945561.760101:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945561.760165:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254754432 00000100:00100000:1.0:1790945561.760179:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254754432 00000100:00100000:1.0:1790945561.760252:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 122 00000100:00100000:1.0:1790945561.760264:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:10540:x1877942254754432:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945561.760293:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945561.760319:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fa61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82e2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.760414:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fa68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.760433:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fa68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.760445:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fa68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945561.760498:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790945561.760521:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fa68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.760550:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fa61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82e2 expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.760592:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fa68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82e2 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.760602:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:1.0:1790945561.760605:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790945561.760609:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133800, rc 0) 00000100:00100000:1.0:1790945561.760732:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:10540:x1877942254754432:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 465us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945561.760739:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 122 00000100:00100000:1.0:1790945561.767588:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945561.767716:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254754560 00000100:00100000:0.0:1790945561.767729:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254754560 00000100:00100000:0.0:1790945561.767813:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 38 00000100:00100000:0.0:1790945561.767825:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2373:x1877942254754560:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945561.767860:0:7919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945561.767889:0:7919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a54fa6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82e9 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790945561.767932:0:7919:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfa91a, blocks: 0x1 00010000:00010000:0.0:1790945561.767961:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1790945561.767966:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945561.767978:0:7919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a54fa6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82e9 expref: 10 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.768012:0:7919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a54fa6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82e9 expref: 10 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.768047:0:7919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d400, rc 0) 00000100:00100000:0.0:1790945561.768133:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:2373:x1877942254754560:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 309us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945561.768142:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 38 00000100:00100000:2.0:1790945561.771510:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945561.771600:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254754816 00000100:00100000:1.0:1790945561.771613:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254754816 00000100:00100000:1.0:1790945561.771878:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 123 00000100:00100000:1.0:1790945561.771891:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:10540:x1877942254754816:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790945561.772075:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:10540:x1877942254754816:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 185us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945561.772085:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 123 00000100:00100000:1.0:1790945561.775852:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945561.778238:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254754944 00000100:00100000:0.0:1790945561.778258:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254754944 00000100:00100000:0.0:1790945561.778484:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 39 00000100:00100000:0.0:1790945561.778498:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:10540:x1877942254754944:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945561.778524:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945561.778553:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fa76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82f0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.778601:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a54fa6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82e9 expref: 11 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.778611:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945561.778616:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945561.778622:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fa76 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f0 expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.778678:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a54fa6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82e9 expref: 11 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.778690:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a54fa6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82e9 expref: 11 pid: 7919 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945561.778719:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6673:1877942273641344:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945561.778996:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8810320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945561.783700:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6673:1877942273641344:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945561.783762:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fa76 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f0 expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.783788:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c000, rc 0) 00000100:00100000:0.0:1790945561.784384:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:10540:x1877942254754944:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 5886us (8550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945561.784396:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 39 00000100:00100000:2.0:1790945561.786957:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945561.787372:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254755072 00000100:00100000:3.0:1790945561.787383:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254755072 00010000:00010000:3.0:1790945561.787426:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a54fa6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82e9 expref: 11 pid: 7919 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945561.787468:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 53 00000100:00100000:3.0:1790945561.787477:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:2373:x1877942254755072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945561.787494:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945561.787516:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a54fa6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82e9 expref: 11 pid: 7919 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.787530:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a54fa6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82e9 expref: 11 pid: 7919 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.787552:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a54fa6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82e9 expref: 11 pid: 7919 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.787570:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945561.787575:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945561.787583:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fa76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f0 expref: 10 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.787593:0:5810:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fa76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f0 expref: 10 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.787633:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fa76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f0 expref: 10 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945561.787715:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8715fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1877942273641472:192.168.202.48@tcp:105: 00000100:00100000:3.0:1790945561.787823:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85209db40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945561.797737:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945561.797871:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254755200 00000100:00100000:2.0:1790945561.797884:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254755200 00002000:00100000:2.0:1790945561.797962:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9bb87397d500 x1877942254755200/t0(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:257/0 lens 504/0 e 0 to 0 dl 1790945572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790945561.797974:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb87397d500 with x1877942254755200 ext(0->12) 00002000:00010000:2.0:1790945561.797989:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb87397d500 00000100:00100000:3.0:1790945561.798329:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8715fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1877942273641472:192.168.202.48@tcp:105: 00010000:00010000:3.0:1790945561.798361:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945561.798436:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:2373:x1877942254755072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10959us (11489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945561.798448:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 53 00000100:00100000:2.0:1790945561.798569:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:2.0:1790945561.798580:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:2372:x1877942254755200:12345-192.168.202.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790945561.799383:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:2372:x1877942254755200:12345-192.168.202.48@tcp:4:lhsmtool_posix.0 Request processed in 802us (1665us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790945561.799392:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2 00002000:00100000:2.0:1790945561.799401:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9bb87397d500 x1877942254755200/t4294967308(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:257/0 lens 504/448 e 0 to 0 dl 1790945572 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790945561.799423:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb87397d500 with x1877942254755200 ext(0->12) 00002000:00010000:2.0:1790945561.799428:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb87397d500 00000100:00100000:1.0:1790945561.805644:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945561.805831:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254755328 00000100:00100000:3.0:1790945561.805853:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254755328 00000100:00100000:3.0:1790945561.805921:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 124 00000100:00100000:3.0:1790945561.806257:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:10540:x1877942254755328:12345-192.168.202.48@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790945561.869490:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967393 is committed 00000004:00080000:2.0:1790945561.869525:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1790945561.869549:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb881032a80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1790945561.869555:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb8814ce300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb881032e40 00000020:00080000:2.0:1790945561.869559:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb8814ce600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb8738ff400 00000001:00080000:2.0:1790945561.869585:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:2.0:1790945561.869612:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1790945561.869629:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb865d48780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1790945561.869632:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb8660f7100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb865d48d80 00000020:00080000:2.0:1790945561.869635:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb8660f7800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb8738fc800 00000004:00080000:2.0:1790945561.869654:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:2.0:1790945561.870239:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945561.870263:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88135fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273641600:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790945561.870369:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945561.870439:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273641600 00000100:00100000:2.0:1790945561.870450:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273641600 00000100:00100000:2.0:1790945561.870507:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790945561.870515:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273641600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790945561.870546:0:6672:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1790945561.870582:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abfa918, atime: 0x6abfa918, ctime: 0x6abfa918, blocks: 0xb 00010000:00010000:2.0:1790945561.870591:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54fa7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.870628:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1790945561.870632:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945561.870637:0:6672:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54fa7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.870653:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54fa7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.870681:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54fa7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.870688:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54fa7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.870702:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790945561.870978:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945561.870997:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54fa7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.871006:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434ae400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945561.871018:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54fa7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.871029:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54fa7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.871062:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54fa7d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.871069:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005be59ed4/0xc5cf2c2a6a54fa7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.871092:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945561.871094:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945561.871096:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945561.871109:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273641728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790945561.871153:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945561.871213:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273641728 00000100:00100000:1.0:1790945561.871218:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273641728 00000100:00100000:1.0:1790945561.871255:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790945561.871263:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1877942273641728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790945561.871281:0:6670:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1790945561.871318:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.871337:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000afe28e06/0xc5cf2c2a6a54f83f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c824f expref: 11 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.871357:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1790945561.871361:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00000100:00100000:2.0:1790945561.871365:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1877942273641600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 849us (996us total) trans 4294967304 rc 0/0 00010000:00010000:1.0:1790945561.871365:0:6670:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945561.871374:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1790945561.871396:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000afe28e06/0xc5cf2c2a6a54f83f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c824f expref: 11 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.871414:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000afe28e06/0xc5cf2c2a6a54f83f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c824f expref: 11 pid: 7919 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945561.871421:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000100:00100000:1.0:1790945561.871426:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87397f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1877942273641856:192.168.202.48@tcp:104: 00000004:00080000:2.0:1790945561.871428:0:3292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:2.0:1790945561.871453:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb8814ad180, transno 4294967301 00000004:00080000:2.0:1790945561.871463:0:3292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:2.0:1790945561.871478:0:3292:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9bb88135fb80 x1877942273641600/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790945577 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1790945561.871490:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb88135fb80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1790945561.871493:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881b6ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945561.871495:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88135fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273641600:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1790945561.871930:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1790945561.872043:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1790945561.874150:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87397f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1877942273641856:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945561.874185:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945561.876534:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:10540:x1877942254755328:12345-192.168.202.48@tcp:44:lhsmtool_posix.0 Request processed in 70590us (70891us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945561.876551:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 124 00000100:00100000:1.0:1790945561.882821:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945561.882879:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945561.882997:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254755584 00000100:00100000:3.0:1790945561.883012:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254755584 00000100:00100000:3.0:1790945561.883085:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 42 00000100:00100000:3.0:1790945561.883097:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:2372:x1877942254755584:12345-192.168.202.48@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790945561.886768:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254755456 00000100:00100000:2.0:1790945561.886791:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254755456 00010000:00010000:2.0:1790945561.886859:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000afe28e06/0xc5cf2c2a6a54f83f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c824f expref: 13 pid: 7919 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945561.886916:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 54 00000100:00100000:2.0:1790945561.886927:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:2373:x1877942254755456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945561.886947:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945561.886953:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000afe28e06/0xc5cf2c2a6a54f83f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c824f expref: 13 pid: 7919 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.886969:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000afe28e06/0xc5cf2c2a6a54f83f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c824f expref: 13 pid: 7919 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.887005:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afe28e06/0xc5cf2c2a6a54f83f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c824f expref: 13 pid: 7919 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.887033:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945561.887037:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945561.887044:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.887069:0:8440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.887104:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945561.887188:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:2373:x1877942254755456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 260us (4391us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945561.887196:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 54 00010000:00010000:2.0:1790945561.887228:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.887238:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.887250:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.887260:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.887277:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945561.887974:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945561.887996:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.888007:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945561.888011:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.888035:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.888058:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.888066:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a54fa84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.888089:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945561.888092:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945561.888094:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945561.889792:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3294:x1877942273641728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18519us (18629us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790945561.889818:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1790945561.890732:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb87397e680/2, rc 0, transno 4294967309 00000100:00100000:0.0:1790945561.890754:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273641728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790945561.926777:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:2372:x1877942254755584:12345-192.168.202.48@tcp:16:lhsmtool_posix.0 Request processed in 43666us (43880us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945561.926795:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 42 00000001:00080000:2.0:1790945561.927943:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1790945561.927965:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1790945561.927993:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1790945561.928015:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1790945561.930609:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945561.930724:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254755840 00000100:00100000:3.0:1790945561.930738:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254755840 00000100:00100000:3.0:1790945561.930820:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 125 00000100:00100000:3.0:1790945561.930833:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:10540:x1877942254755840:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790945561.930911:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945561.930960:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fa68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82e2 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.930994:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:3.0:1790945561.931003:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945561.931073:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.931091:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.931103:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790945561.931873:0:7211:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000072496339 reply state 00000000571059e0 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945561.931887:0:7211:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945561.932024:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:10540:x1877942254755840:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 1192us (1428us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1790945561.932032:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 125 00010000:00010000:3.0:1790945561.934809:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.934833:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.934843:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.934849:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945561.934855:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.934864:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.934884:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:3.0:1790945561.934909:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945561.934915:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.934922:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fa8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945561.936849:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945561.937293:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254755968 00000100:00100000:2.0:1790945561.937310:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254755968 00000100:00100000:2.0:1790945561.937390:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 43 00000100:00100000:2.0:1790945561.937431:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2370:x1877942254755968:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790945561.937906:0:7919:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790945561.937911:0:7919:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790945560 00002000:00010000:2.0:1790945561.937915:0:7919:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790945560 00002000:00010000:2.0:1790945561.937918:0:7919:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790945562 -> 1790945560 00002000:00010000:2.0:1790945561.937920:0:7919:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790945561.938293:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2370:x1877942254755968:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 Request processed in 891us (1456us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790945561.938303:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 43 00000100:00100000:1.0:1790945561.941797:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945561.941953:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254756224 00000100:00100000:2.0:1790945561.941966:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254756224 00000100:00100000:0.0:1790945561.942124:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 126 00000100:00100000:0.0:1790945561.942138:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:10540:x1877942254756224:12345-192.168.202.48@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790945561.942222:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.942241:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82d4 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.942271:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.942314:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82d4 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.942330:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82d4 expref: 15 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945561.942346:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877942273641984:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945561.942442:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881032b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945561.945554:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945561.945694:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254756352 00000100:00100000:1.0:1790945561.945708:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254756352 00010000:00010000:1.0:1790945561.945760:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa4c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82d4 expref: 16 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945561.945822:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 55 00000100:00100000:1.0:1790945561.945834:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:2372:x1877942254756352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945561.945873:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945561.945881:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa4c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82d4 expref: 16 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.945897:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82d4 expref: 16 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.945968:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:1.0:1790945561.946063:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.946074:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.946083:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945561.946108:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945561.946182:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:2372:x1877942254756352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 350us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945561.946192:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 55 00010000:00010000:0.0:1790945561.946968:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fa4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82d4 expref: 15 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945561.947000:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877942273641984:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945561.947029:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.947050:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.947059:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.947095:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.947102:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.947123:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.947129:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945561.947180:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.947189:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.947201:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:0.0:1790945561.947204:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790945561.947209:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.947214:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fa92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945561.947290:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:10540:x1877942254756224:12345-192.168.202.48@tcp:55:lhsmtool_posix.0 Request processed in 5154us (5504us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790945561.947300:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 126 00000100:00100000:2.0:1790945561.951446:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945561.951549:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254756480 00000100:00100000:0.0:1790945561.951563:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254756480 00000100:00100000:0.0:1790945561.951695:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 44 00000100:00100000:0.0:1790945561.951707:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2370:x1877942254756480:12345-192.168.202.48@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790945561.951774:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.951810:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fa76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f0 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.951837:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945561.951842:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790945561.951848:0:6670:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.951894:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fa76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f0 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.951910:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fa76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f0 expref: 7 pid: 6673 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945561.951940:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1877942273642112:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945561.952053:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881032b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945561.956114:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945561.956220:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254756608 00000100:00100000:2.0:1790945561.956234:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254756608 00010000:00010000:2.0:1790945561.956291:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fa76 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f0 expref: 8 pid: 6673 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945561.956342:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 56 00000100:00100000:2.0:1790945561.956354:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2373:x1877942254756608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945561.956374:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945561.956403:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fa76 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f0 expref: 8 pid: 6673 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.956438:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fa76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f0 expref: 8 pid: 6673 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.956470:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945561.956477:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790945561.956484:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.956496:0:8440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.956522:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945561.957202:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2373:x1877942254756608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 846us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945561.957213:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 56 00010000:00010000:0.0:1790945561.957884:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fa76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f0 expref: 7 pid: 6673 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945561.957905:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1877942273642112:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945561.957933:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.957946:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.957957:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.958021:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.958031:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.958135:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.958142:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1da00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945561.958147:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.958158:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.958176:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945561.958185:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008430b785/0xc5cf2c2a6a54fa99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945561.958262:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2370:x1877942254756480:12345-192.168.202.48@tcp:1:lhsmtool_posix.0 Request processed in 6557us (6829us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945561.958272:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 44 00000100:00100000:1.0:1790945561.965514:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945561.965599:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254756864 00000100:00100000:3.0:1790945561.965613:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254756864 00000100:00100000:3.0:1790945561.965705:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 127 00000100:00100000:3.0:1790945561.965716:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:10540:x1877942254756864:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790945561.965824:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54faa0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.965846:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54faa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.965859:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54faa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.966133:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.966146:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82db expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.966154:0:7211:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.966194:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82db expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.966363:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82db expref: 15 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945561.966381:0:7211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8715fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273642240:192.168.202.48@tcp:104: 00000100:00100000:3.0:1790945561.966480:0:7211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85100e000 going to sleep for 11 seconds 00000100:00100000:1.0:1790945561.969884:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945561.970249:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254756992 00000100:00100000:2.0:1790945561.970264:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254756992 00010000:00010000:2.0:1790945561.970323:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa5a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82db expref: 16 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945561.970376:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 57 00000100:00100000:2.0:1790945561.970388:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:2373:x1877942254756992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945561.970409:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945561.970417:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa5a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82db expref: 16 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.970457:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82db expref: 16 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.970485:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:2.0:1790945561.970492:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.970502:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.970511:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.970534:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945561.970614:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:2373:x1877942254756992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 227us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945561.970621:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 57 00010000:00010000:3.0:1790945561.971394:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fa5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82db expref: 15 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945561.971419:0:7211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8715fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273642240:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945561.971445:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.971456:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.971463:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945561.971759:0:7211:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1790945561.971959:0:7211:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1790945561.972407:0:7211:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1790945561.972516:0:7211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8715fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7211:1877942273642368:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790945561.972593:0:7211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945561.972711:0:7211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85100e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945561.973786:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273642368 00000100:00100000:0.0:1790945561.973798:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273642368 00000100:00100000:0.0:1790945561.973995:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790945561.974006:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7211:x1877942273642368:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790945561.974141:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7211:x1877942273642368:12345-0@lo:1000:mdt00_003.0 Request processed in 137us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945561.974150:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790945561.974216:0:7211:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1790945561.974224:0:7211:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1790945561.974249:0:7211:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9bb87397e680 x1877942273641728/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790945577 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945561.974278:0:7211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8715fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7211:1877942273642368:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1790945561.974916:0:7211:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1790945561.975007:0:7211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8715fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7211:1877942273642496:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790945561.975070:0:7211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945561.975551:0:7211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85100e000 going to sleep for 11 seconds 00000100:00100000:1.0:1790945561.975592:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273642496 00000100:00100000:1.0:1790945561.975600:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273642496 00000100:00100000:1.0:1790945561.975640:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790945561.975648:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7211:x1877942273642496:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790945561.976122:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7211:x1877942273642496:12345-0@lo:1000:mdt00_003.0 Request processed in 472us (1049us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790945561.976141:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790945561.976341:0:7211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8715fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7211:1877942273642496:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1790945561.976387:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976398:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976406:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976412:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945561.976417:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976425:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976444:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:3.0:1790945561.976448:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945561.976454:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976459:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54faa7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976513:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54f9ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976519:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54f9ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976524:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54f9ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976529:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945561.976531:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54f9ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976537:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54f9ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976544:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:3.0:1790945561.976546:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945561.976555:0:7211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030600/0xc5cf2c2a6a54f9f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82bf expref: 18 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976567:0:7211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030600/0xc5cf2c2a6a54f9f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82bf expref: 18 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976576:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030600/0xc5cf2c2a6a54f9f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82bf expref: 18 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.976605:0:7211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030600/0xc5cf2c2a6a54f9f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82bf expref: 18 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945561.976628:0:7211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88165f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273642624:192.168.202.48@tcp:105: 00000100:00100000:3.0:1790945561.976730:0:7211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85100e000 going to sleep for 11 seconds 00000100:00100000:1.0:1790945561.981232:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945561.981316:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254757120 00000100:00100000:2.0:1790945561.981329:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254757120 00000100:00100000:2.0:1790945561.981393:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 31 00000100:00100000:2.0:1790945561.981405:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:10539:x1877942254757120:12345-192.168.202.48@tcp:49:lfs.0 00000100:00100000:2.0:1790945561.981587:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:10539:x1877942254757120:12345-192.168.202.48@tcp:49:lfs.0 Request processed in 183us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945561.981596:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 31 00000100:00100000:3.0:1790945561.983907:0:7211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88165f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273642624:192.168.202.48@tcp:105: 00010000:00010000:3.0:1790945561.983949:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54f9ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945561.983961:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54f9ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945561.984433:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945561.984528:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254757376 00000100:00100000:1.0:1790945561.984537:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254757376 00000100:00100000:1.0:1790945561.984601:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 128 00000100:00100000:1.0:1790945561.984612:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:10539:x1877942254757376:12345-192.168.202.48@tcp:58:lfs.0 00000040:00080000:1.0:1790945561.985343:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1790945561.985459:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:10539:x1877942254757376:12345-192.168.202.48@tcp:58:lfs.0 Request processed in 845us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945561.985470:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 128 00010000:00010000:2.0:1790945561.987827:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54faae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.987862:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54faae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.987897:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54faae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.987914:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54faae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.987933:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54faae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.987940:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54faae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.987947:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434aea00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945561.987951:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54faae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.987959:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54faae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.987974:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:2.0:1790945561.987977:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945561.987983:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54faae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.987999:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54faae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.988017:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54faa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.988023:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54faa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.988045:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54faa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.988050:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945561.988054:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54faa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.988060:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54faa0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.988069:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:2.0:1790945561.988072:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790945561.988075:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54faa0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.988081:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54faa0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945561.988339:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+18:10540:x1877942254756864:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 22618us (22831us total) trans 4294967407 rc 0/0 00000100:00100000:2.0:1790945561.988353:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 127 00000020:00080000:2.0:1790945561.988361:0:7211:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790945561.989462:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945561.989471:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790945561.989510:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790945561.989518:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790945561.989729:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88165f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1877942273642752:192.168.202.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790945561.989823:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85100e600 going to sleep for 11 seconds 00000100:00100000:3.0:1790945561.997480:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945561.997691:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254757632 00000100:00100000:2.0:1790945561.997704:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254757632 00000100:00100000:2.0:1790945561.997753:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 32 00000100:00100000:2.0:1790945561.997760:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8477f1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:10540:x1877942254757632:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790945561.997925:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88165f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1877942273642752:192.168.202.48@tcp:107:hsm_cdtr.0 00000004:00080000:2.0:1790945561.999228:0:5827:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790945561.999345:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1790945561.999417:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54fab5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.999437:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54fab5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.999450:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54fab5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.999460:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54fab5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.999466:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54fab5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.999472:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54fab5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945561.999544:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790945561.999702:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8477f1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:10540:x1877942254757632:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 1936us (2228us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1790945561.999712:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 32 00000020:00080000:2.0:1790945561.999720:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790945562.000584:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945562.000594:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54fab5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945562.000604:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434ae000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945562.000608:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54fab5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945562.000619:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54fab5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945562.000636:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bb845042a00) 00010000:00010000:1.0:1790945562.000639:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790945562.000645:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54fab5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945562.000651:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54fab5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945562.000770:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945562.000772:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945562.000773:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945562.001895:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945562.002002:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254757760 00000100:00100000:1.0:1790945562.002014:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254757760 00000100:00080000:3.0:1790945562.002124:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945562.002204:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 129 00000100:00100000:1.0:1790945562.002216:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:10541:x1877942254757760:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790945562.002254:0:5825:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790945562.002375:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:10541:x1877942254757760:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 Request processed in 161us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945562.002388:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 129 00000100:00100000:0.0:1790945562.018031:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945562.018182:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254758016 00000100:00100000:1.0:1790945562.018198:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254758016 00000100:00100000:1.0:1790945562.018275:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 130 00000100:00100000:1.0:1790945562.018287:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:10541:x1877942254758016:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945562.018323:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945562.018351:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fabc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82f7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945562.018492:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54fac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945562.018513:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54fac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945562.018528:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54fac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945562.018565:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790945562.018775:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fabc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f7 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945562.018797:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54fac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f7 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945562.018819:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:1.0:1790945562.018823:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790945562.018827:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133200, rc 0) 00000100:00100000:1.0:1790945562.018902:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:10541:x1877942254758016:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 617us (887us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1790945562.018911:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 130 00000100:00100000:3.0:1790945562.031647:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945562.031848:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254758272 00000100:00100000:0.0:1790945562.031861:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254758272 00000100:00100000:0.0:1790945562.031976:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 131 00000100:00100000:0.0:1790945562.031999:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:10541:x1877942254758272:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790945562.032117:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fad1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945562.032141:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945562.032157:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945562.032409:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945562.032417:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fad1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945562.033178:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fad1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945562.033186:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945562.033192:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fad1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945562.033202:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fad1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945562.033220:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:0.0:1790945562.033224:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790945562.033231:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fad1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945562.033238:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fad1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790945562.033735:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945562.033742:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1790945562.034147:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:10541:x1877942254758272:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 2155us (2506us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1790945562.034161:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 131 00000040:00080000:3.0:1790945562.034492:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790945562.034503:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790945562.038549:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945562.038696:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254758400 00000100:00100000:2.0:1790945562.038710:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254758400 00000100:00100000:2.0:1790945562.038782:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 132 00000100:00100000:2.0:1790945562.038796:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:10543:x1877942254758400:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945562.038836:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945562.038863:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fad8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c82fe expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.039341:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fadf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.039362:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fadf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.039376:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fadf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.039394:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fae6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.039402:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.039409:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.039819:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54faed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.039834:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82b8 expref: 24 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.039844:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54faed lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.039889:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82b8 expref: 24 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.040096:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82b8 expref: 24 pid: 5825 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945562.040116:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88135df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273642880:192.168.202.48@tcp:104: 00000100:00100000:2.0:1790945562.040245:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945562.040874:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945562.041189:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254758656 00000100:00100000:0.0:1790945562.041201:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254758656 00000100:00100000:0.0:1790945562.041256:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00100000:0.0:1790945562.041267:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:10541:x1877942254758656:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790945562.041525:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+26:10541:x1877942254758656:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 259us (653us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1790945562.041550:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00100000:2.0:1790945562.043783:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88135df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273642880:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945562.043897:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54faed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945562.045149:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945562.045313:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254758912 00000100:00100000:1.0:1790945562.045327:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254758912 00000100:00100000:1.0:1790945562.045387:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 34 00000100:00100000:1.0:1790945562.045397:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+26:5613:x1877942254758912:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790945562.045726:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:5613:x1877942254758912:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 329us (584us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1790945562.045734:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 34 00000100:00100000:3.0:1790945562.049043:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945562.049256:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254759040 00000100:00100000:2.0:1790945562.049270:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254759040 00010000:00010000:2.0:1790945562.049338:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82b8 expref: 27 pid: 5825 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945562.049442:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 58 00000100:00100000:2.0:1790945562.049454:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:2372:x1877942254759040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945562.049474:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945562.049483:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82b8 expref: 27 pid: 5825 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.049499:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82b8 expref: 27 pid: 5825 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.049529:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54f9dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82b8 expref: 27 pid: 5825 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.049575:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:2.0:1790945562.049582:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54faed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.049604:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54faed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945562.049613:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54faed lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.049823:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54faed lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.049844:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54faed lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945562.049910:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790945562.049917:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790945562.049945:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54faed lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.049960:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54faed lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.049971:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fadf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.049987:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fadf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.049995:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fadf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050001:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945562.050007:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fadf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050016:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fadf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050025:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:3.0:1790945562.050028:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945562.050033:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fadf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050053:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fadf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050067:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050072:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fae6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050077:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050082:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945562.050085:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050090:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050098:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bb845042100) 00010000:00010000:3.0:1790945562.050100:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945562.050103:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fae6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050108:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fae6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050151:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fad8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82fe expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050167:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54faed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82fe expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945562.050181:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:3.0:1790945562.050183:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945562.050186:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434ae000, rc 0) 00000100:00100000:3.0:1790945562.050273:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+26:10543:x1877942254758400:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 11480us (11743us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945562.050281:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 132 00010000:00010000:2.0:1790945562.050533:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945562.050566:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:2372:x1877942254759040:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1114us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945562.050576:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 58 00000100:00100000:1.0:1790945562.266953:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945562.267148:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945562.267193:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945562.267236:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945562.267288:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254759168 00000100:00100000:3.0:1790945562.267301:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254759168 00000100:00100000:3.0:1790945562.267370:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 288 00000100:00100000:3.0:1790945562.267382:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:2371:x1877942254759168:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945562.267498:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:2371:x1877942254759168:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 119us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945562.267506:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 288 00000100:00100000:2.0:1790945562.267646:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254759552 00000100:00100000:2.0:1790945562.267652:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254759552 00000100:00100000:2.0:1790945562.267736:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 134 00000100:00100000:2.0:1790945562.267745:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254759552:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945562.267781:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254759552:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 38us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945562.267788:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 134 00000100:00080000:3.0:1790945562.268187:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945562.274122:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254759296 00000100:00100000:0.0:1790945562.274144:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254759296 00000100:00100000:0.0:1790945562.274236:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254759424 00000100:00100000:0.0:1790945562.274241:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254759424 00000100:00100000:0.0:1790945562.274275:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 74 00000100:00100000:0.0:1790945562.274288:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2371:x1877942254759296:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945562.274397:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2371:x1877942254759296:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 112us (7457us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945562.274406:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 74 00000100:00100000:0.0:1790945562.274428:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 75 00000100:00100000:0.0:1790945562.274435:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254759424:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945562.274463:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2371:x1877942254759424:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 29us (7227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945562.274470:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 75 00000100:00080000:1.0:1790945562.274712:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790945562.331871:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790945562.838036:0:12038:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945562.838049:0:12038:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790945562.838099:0:12038:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790945562.838106:0:12038:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790945563.079480:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945563.079569:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254759808 00000100:00100000:0.0:1790945563.079589:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254759808 00000100:00100000:0.0:1790945563.079696:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 133 00000100:00100000:0.0:1790945563.079708:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:10567:x1877942254759808:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945563.079755:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945563.079782:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54faf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8305 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945563.079952:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54fafb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945563.079978:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54fafb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945563.079992:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54fafb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945563.080008:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790945563.080171:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a54faf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8305 expref: 28 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945563.080194:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54fafb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8305 expref: 27 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945563.080205:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:0.0:1790945563.080209:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790945563.080213:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d800, rc 0) 00000100:00100000:0.0:1790945563.080308:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:10567:x1877942254759808:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 601us (836us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1790945563.080316:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 133 00000100:00100000:0.0:1790945563.084197:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945563.084513:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254759936 00000100:00100000:2.0:1790945563.084526:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254759936 00000100:00100000:2.0:1790945563.084601:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 134 00000100:00100000:2.0:1790945563.084611:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:10567:x1877942254759936:12345-192.168.202.48@tcp:54:lfs.0 00010000:00010000:2.0:1790945563.084722:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945563.084823:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945563.084838:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945563.084873:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945563.084882:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945563.084890:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945563.084896:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434afa00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945563.084901:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945563.084909:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945563.084923:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:2.0:1790945563.084927:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790945563.084932:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945563.084939:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945563.085083:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:10567:x1877942254759936:12345-192.168.202.48@tcp:54:lfs.0 Request processed in 471us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945563.085097:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 134 00000100:00100000:2.0:1790945563.218521:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945563.218623:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254760064 00000100:00100000:0.0:1790945563.218637:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254760064 00000100:00100000:0.0:1790945563.218773:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 45 00000100:00100000:0.0:1790945563.218785:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2370:x1877942254760064:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1790945563.218820:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945563.218849:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54fb10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c830c expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790945563.218909:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abfa918, atime: 0x6abfa918, ctime: 0x6abfa918, blocks: 0xb 00010000:00010000:0.0:1790945563.218936:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=309s v=(0 0) 00010000:00010000:0.0:1790945563.218942:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945563.218955:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54fb10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c830c expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945563.218979:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54fb10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c830c expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790945563.218981:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790945563.218995:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c400, rc 0) 00000100:00100000:0.0:1790945563.219082:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2370:x1877942254760064:12345-192.168.202.48@tcp:101:cat.0 Request processed in 299us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945563.219090:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 45 00000100:00100000:3.0:1790945563.230627:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945563.230811:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254760192 00000100:00100000:0.0:1790945563.230827:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254760192 00002000:00100000:0.0:1790945563.230905:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9bb881932680 x1877942254760192/t0(0) o3->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:259/0 lens 488/0 e 0 to 0 dl 1790945574 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790945563.230919:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb881932680 with x1877942254760192 ext(0->4095) 00002000:00010000:0.0:1790945563.230927:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb881932680 00000100:00100000:0.0:1790945563.230969:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3 00000100:00100000:0.0:1790945563.230991:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2371:x1877942254760192:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1790945563.235866:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2371:x1877942254760192:12345-192.168.202.48@tcp:3:cat.0 Request processed in 4859us (5235us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1790945563.235890:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3 00002000:00100000:1.0:1790945563.235907:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9bb881932680 x1877942254760192/t0(0) o3->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:259/0 lens 488/4536 e 0 to 0 dl 1790945574 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945563.235920:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb881932680 with x1877942254760192 ext(0->4095) 00002000:00010000:1.0:1790945563.235928:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb881932680 00010000:00010000:1.0:1790945563.356584:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945564.379829:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945565.408509:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945565.468128:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88135d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273643008:0@lo:400:kworker.0 00000100:00100000:1.0:1790945565.468240:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945565.468574:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb851950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273643392:0@lo:400:kworker.0 00000100:00100000:3.0:1790945565.468615:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945565.468714:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273643392 00000100:00100000:3.0:1790945565.468743:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273643392 00000100:00100000:3.0:1790945565.468831:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790945565.468841:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1877942273643392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945565.468918:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1877942273643392:12345-0@lo:400:kworker.0 Request processed in 78us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945565.468927:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1790945565.468954:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945565.468995:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb851950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273643392:0@lo:400:kworker.0 00000100:00100000:3.0:1790945565.469036:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88135d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273643136:0@lo:400:kworker.0 00000100:00100000:3.0:1790945565.469068:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945565.469091:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945565.469096:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8715fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273643264:0@lo:400:kworker.0 00000100:00100000:3.0:1790945565.469119:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945565.469148:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273643136 00000100:00100000:3.0:1790945565.469153:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273643136 00000100:00100000:3.0:1790945565.469180:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273643264 00000100:00100000:3.0:1790945565.469183:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273643264 00000100:00100000:3.0:1790945565.469207:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790945565.469214:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273643136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945565.469264:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273643136:12345-0@lo:400:kworker.0 Request processed in 50us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945565.469270:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790945565.469284:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790945565.469290:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273643264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945565.469318:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273643264:12345-0@lo:400:kworker.0 Request processed in 28us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945565.469324:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1790945565.469374:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945565.469392:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8715fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273643264:0@lo:400:kworker.0 00000100:00100000:3.0:1790945565.469402:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88135d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273643136:0@lo:400:kworker.0 00000100:00100000:0.0:1790945565.469690:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273643008 00000100:00100000:0.0:1790945565.469697:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273643008 00000100:00100000:0.0:1790945565.469729:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1790945565.469745:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273643008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945565.470586:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790945565.470601:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb851950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273643648:0@lo:400:kworker.0 00000100:00100000:2.0:1790945565.470849:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945565.470897:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273643648 00000100:00100000:2.0:1790945565.471002:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273643648 00000100:00100000:2.0:1790945565.471058:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790945565.471067:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3293:x1877942273643648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945565.471120:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3293:x1877942273643648:12345-0@lo:400:kworker.0 Request processed in 54us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945565.471128:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790945565.471168:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb851950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273643648:0@lo:400:kworker.0 00000100:00080000:3.0:1790945565.471841:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945565.471987:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945565.472004:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb851951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273643520:0@lo:400:kworker.0 00000100:00100000:3.0:1790945565.472059:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945565.472288:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273643008:12345-0@lo:400:kworker.0 Request processed in 2542us (4046us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945565.472299:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1790945565.472576:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273643520 00000100:00100000:2.0:1790945565.472585:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273643520 00000100:00100000:2.0:1790945565.472652:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790945565.472678:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273643520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945565.472736:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273643520:12345-0@lo:400:kworker.0 Request processed in 60us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945565.472742:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1790945565.473243:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945565.473295:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb851951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273643520:0@lo:400:kworker.0 00000100:00100000:1.0:1790945565.474635:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88135d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273643008:0@lo:400:kworker.0 00000100:00100000:1.0:1790945565.979982:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273643776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945565.980079:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945565.980189:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273643776 00000100:00100000:1.0:1790945565.980199:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273643776 00000100:00100000:1.0:1790945565.980258:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790945565.980269:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273643776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790945565.980314:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945565.980366:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273643776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945565.980375:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790945565.980432:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273643776:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1790945565.985143:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311780482330ns, next at 312780479231ns, rc = 0 00000100:00100000:3.0:1790945565.985184:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273643904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945565.985274:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945565.985356:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273643904 00000100:00100000:3.0:1790945565.985496:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273643904 00000100:00100000:3.0:1790945565.985553:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790945565.985564:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1877942273643904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945565.985609:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790945565.985686:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1877942273643904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945565.985694:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790945565.985755:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273643904:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1790945566.122559:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:3.0:1790945566.427818:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790945567.069997:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1790945567.070023:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1790945567.094810:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000004:00080000:1.0:1790945567.094885:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1790945567.094914:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb85100e0c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1790945567.094920:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb873c67b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb85100e300 00000020:00080000:1.0:1790945567.094925:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb873c67c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb87b555c00 00000020:00080000:1.0:1790945567.094951:0:5846:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1790945567.095104:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:1.0:1790945567.095133:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273644032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790945567.095225:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945567.095410:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273644032 00000100:00100000:0.0:1790945567.095421:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273644032 00000100:00080000:1.0:1790945567.095481:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790945567.095504:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790945567.095517:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273644032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1790945567.096079:0:6670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1790945567.096084:0:6670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1790945560 -> 1790945560 00002000:00010000:0.0:1790945567.096087:0:6670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1790945560 -> 1790945560 00002000:00010000:0.0:1790945567.096089:0:6670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790945560 -> 1790945560 00002000:00010000:0.0:1790945567.096091:0:6670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000020:00080000:3.0:1790945567.096415:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1790945567.097448:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1877942273644032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1927us (2216us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1790945567.097462:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790945567.099186:0:3295:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1790945567.099201:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb87397e680, transno 4294967309 00000004:00080000:1.0:1790945567.099218:0:3295:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:1.0:1790945567.099260:0:3295:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9bb87fe5c000 x1877942273644032/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790945583 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1790945567.099274:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb87fe5c000/2, rc 0, transno 4294967312 00000100:00100000:1.0:1790945567.099280:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273644032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790945567.380351:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945567.380466:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254760320 00000100:00100000:3.0:1790945567.380486:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254760320 00000100:00100000:3.0:1790945567.380606:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 290 00000100:00100000:3.0:1790945567.380620:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2373:x1877942254760320:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945567.380744:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2373:x1877942254760320:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 126us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945567.380765:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 290 00000100:00100000:0.0:1790945567.384234:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945567.384313:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945567.384342:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945567.384370:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945567.384421:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254760832 00000100:00100000:3.0:1790945567.384434:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254760832 00000100:00100000:3.0:1790945567.384527:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254760448 00000100:00100000:3.0:1790945567.384531:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254760448 00000100:00100000:3.0:1790945567.384558:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 138 00000100:00100000:3.0:1790945567.384570:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2373:x1877942254760832:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945567.384687:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2373:x1877942254760832:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 118us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945567.384695:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 138 00000100:00100000:3.0:1790945567.384714:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 139 00000100:00100000:3.0:1790945567.384722:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:2373:x1877942254760448:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945567.384761:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:2373:x1877942254760448:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 28us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945567.384768:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 139 00000100:00080000:3.0:1790945567.384795:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945567.387315:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254760576 00000100:00100000:2.0:1790945567.387334:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254760576 00000100:00100000:2.0:1790945567.387421:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254760704 00000100:00100000:2.0:1790945567.387425:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254760704 00000100:00100000:2.0:1790945567.387461:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 78 00000100:00100000:2.0:1790945567.387473:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2373:x1877942254760576:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945567.387567:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2373:x1877942254760576:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 96us (3345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945567.387576:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 78 00000100:00100000:2.0:1790945567.387596:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00100000:2.0:1790945567.387603:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254760704:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945567.387627:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254760704:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (3257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945567.387633:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00080000:0.0:1790945567.388037:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945567.388042:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790945567.453974:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945567.998116:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945567.998393:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254760960 00000100:00100000:2.0:1790945567.998407:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254760960 00000100:00100000:2.0:1790945567.998487:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 135 00000100:00100000:2.0:1790945567.998499:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:10228:x1877942254760960:12345-192.168.202.48@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790945567.999000:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:10228:x1877942254760960:12345-192.168.202.48@tcp:60:lhsmtool_posix.0 Request processed in 500us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945567.999010:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 135 00000100:00100000:2.0:1790945568.011010:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945568.011529:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254761216 00000100:00100000:1.0:1790945568.011544:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254761216 00000100:00100000:1.0:1790945568.011631:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 35 00000100:00100000:1.0:1790945568.011643:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:10228:x1877942254761216:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790945568.012287:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:10228:x1877942254761216:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 643us (1290us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1790945568.012297:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 35 00000040:00080000:2.0:1790945568.156029:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945568.156044:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945568.156092:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790945568.156107:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790945568.476184:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945569.504911:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790945569.904563:0:12238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:52:48 (1790945568) 00010000:00010000:3.0:1790945570.523841:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945570.588156:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb851953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273644160:0@lo:400:kworker.0 00000100:00100000:3.0:1790945570.588240:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945570.588327:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb851950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273644288:0@lo:400:kworker.0 00000100:00100000:1.0:1790945570.588377:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945570.588406:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273644800:0@lo:400:kworker.0 00000100:00100000:2.0:1790945570.588421:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273644160 00000100:00100000:2.0:1790945570.588430:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273644160 00000100:00100000:1.0:1790945570.588430:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945570.588453:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945570.588458:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273644672:0@lo:400:kworker.0 00000100:00100000:2.0:1790945570.588479:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1790945570.588479:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945570.588488:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273644160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945570.588503:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb851950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273644544:0@lo:400:kworker.0 00000100:00100000:1.0:1790945570.588526:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945570.588534:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273644160:12345-0@lo:400:kworker.0 Request processed in 47us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945570.588541:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945570.588542:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1790945570.588545:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb851951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273644416:0@lo:400:kworker.0 00000100:00100000:1.0:1790945570.588566:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945570.588591:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273644800 00000100:00100000:2.0:1790945570.588594:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273644800 00000100:00100000:1.0:1790945570.588603:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273644288 00000100:00100000:1.0:1790945570.588606:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273644288 00000100:00100000:2.0:1790945570.588622:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273644544 00000100:00100000:2.0:1790945570.588624:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273644544 00000100:00100000:1.0:1790945570.588629:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273644672 00000100:00100000:1.0:1790945570.588631:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273644672 00000100:00100000:1.0:1790945570.588641:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273644416 00000100:00100000:2.0:1790945570.588643:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790945570.588644:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273644416 00000100:00100000:2.0:1790945570.588648:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273644800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945570.588675:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790945570.588682:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273644288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945570.588704:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273644800:12345-0@lo:400:kworker.0 Request processed in 55us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945570.588708:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273644288:12345-0@lo:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945570.588711:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790945570.588713:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790945570.588735:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790945570.588735:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790945570.588743:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273644544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945570.588743:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273644672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945570.588769:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273644672:12345-0@lo:400:kworker.0 Request processed in 28us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945570.588772:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273644544:12345-0@lo:400:kworker.0 Request processed in 32us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945570.588775:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790945570.588778:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790945570.588791:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790945570.588796:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273644416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945570.588807:0:3295:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1790945570.588813:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb88135fb80, transno 4294967304 00000100:00100000:1.0:1790945570.588822:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273644416:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945570.588825:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb851950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273644544:0@lo:400:kworker.0 00000100:00100000:1.0:1790945570.588828:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790945570.588844:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb851951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273644416:0@lo:400:kworker.0 00000100:00100000:1.0:1790945570.588880:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273644672:0@lo:400:kworker.0 00000100:00100000:1.0:1790945570.588891:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb851950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273644288:0@lo:400:kworker.0 00000100:00100000:1.0:1790945570.588898:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273644800:0@lo:400:kworker.0 00000100:00080000:0.0:1790945570.589487:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790945570.589493:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945570.589496:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945570.589578:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb851953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273644160:0@lo:400:kworker.0 00000100:00100000:1.0:1790945571.100742:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945571.100764:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273644928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945571.100830:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945571.101110:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273644928 00000100:00100000:2.0:1790945571.101119:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273644928 00000100:00100000:2.0:1790945571.101170:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790945571.101192:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88136ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273644928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945571.101225:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945571.101272:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88136ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273644928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945571.101279:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790945571.101335:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273644928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945571.102312:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273645056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945571.102356:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945571.102509:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273645056 00000100:00100000:2.0:1790945571.102514:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273645056 00000100:00100000:2.0:1790945571.102567:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790945571.102575:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88133ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1877942273645056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945571.102602:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945571.102644:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88133ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1877942273645056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945571.102651:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790945571.104746:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273645056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945571.189078:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945571.189517:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254761472 00000100:00100000:1.0:1790945571.189527:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254761472 00000100:00100000:1.0:1790945571.189609:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 136 00000100:00100000:1.0:1790945571.189621:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:11276:x1877942254761472:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945571.189644:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945571.189688:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fb17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8313 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.189771:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb1e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.189805:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.189818:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.189832:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb25 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.189838:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.189845:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.190099:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fb2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.190109:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fb2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.190116:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fb2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945571.190124:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1790945571.190203:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.190210:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb1e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.190218:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.190228:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133a00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945571.190233:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.190240:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb1e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.190252:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bb851c9ab00) 00010000:00010000:1.0:1790945571.190255:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945571.190260:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb1e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.190266:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb1e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.190279:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.190286:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb25 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.190292:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790945571.190491:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790945571.191509:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132c00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945571.191515:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.191525:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb25 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.191567:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bb843765800) 00010000:00010000:1.0:1790945571.191570:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945571.191574:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb25 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.191581:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb25 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.192111:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fb17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8313 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.192128:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fb2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8313 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945571.192136:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a900) 00010000:00010000:1.0:1790945571.192139:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945571.192142:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133000, rc 0) 00000100:00100000:1.0:1790945571.192224:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+17:11276:x1877942254761472:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 2604us (3151us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1790945571.192234:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 136 00000100:00100000:3.0:1790945571.197105:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945571.197196:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254761600 00000100:00100000:1.0:1790945571.197207:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254761600 00000100:00100000:0.0:1790945571.197487:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945571.197778:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 137 00000100:00100000:1.0:1790945571.197789:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+17:11276:x1877942254761600:12345-192.168.202.48@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790945571.198247:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+17:11276:x1877942254761600:12345-192.168.202.48@tcp:59:lhsmtool_posix.0 Request processed in 116us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945571.198256:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 137 00000100:00100000:3.0:1790945571.198446:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254761728 00000100:00100000:3.0:1790945571.198452:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254761728 00000100:00100000:3.0:1790945571.198497:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:3.0:1790945571.198506:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+17:2370:x1877942254761728:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945571.198517:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945571.198539:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fb2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8313 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945571.198654:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a900) 00010000:00010000:3.0:1790945571.198685:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945571.198737:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:2370:x1877942254761728:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 231us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945571.198744:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9 00000040:00080000:0.0:1790945571.227919:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790945571.227929:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790945571.227966:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790945571.227974:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790945571.549020:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790945572.158566:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1790945572.171210:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1790945572.171371:0:5846:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1790945572.171400:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1790945572.171411:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1790945572.502521:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945572.502568:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945572.502636:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945572.502691:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945572.502754:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254761984 00000100:00100000:1.0:1790945572.502765:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254761984 00000100:00100000:1.0:1790945572.502820:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 143 00000100:00100000:1.0:1790945572.502831:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:2370:x1877942254761984:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945572.502912:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:2370:x1877942254761984:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 81us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945572.502921:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 143 00000100:00100000:0.0:1790945572.503641:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945572.503691:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254761856 00000100:00100000:0.0:1790945572.503697:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254761856 00000100:00100000:0.0:1790945572.503744:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 292 00000100:00100000:0.0:1790945572.503754:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254761856:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945572.503798:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254761856:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 45us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945572.503805:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 292 00000100:00100000:2.0:1790945572.504116:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254762240 00000100:00100000:2.0:1790945572.504121:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254762240 00000100:00100000:2.0:1790945572.504168:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254762112 00000100:00100000:2.0:1790945572.504172:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254762112 00000100:00100000:2.0:1790945572.504196:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 82 00000100:00100000:2.0:1790945572.504203:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2370:x1877942254762240:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945572.504236:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2370:x1877942254762240:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 34us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945572.504242:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 82 00000100:00100000:2.0:1790945572.504257:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00100000:2.0:1790945572.504263:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254762112:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945572.504297:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254762112:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 34us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945572.504304:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00100000:2.0:1790945572.504324:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254762368 00000100:00100000:2.0:1790945572.504328:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254762368 00000100:00100000:2.0:1790945572.504355:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 144 00000100:00100000:2.0:1790945572.504361:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254762368:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945572.504387:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254762368:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945572.504393:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 144 00000100:00080000:0.0:1790945572.504735:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790945572.504741:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945572.504743:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790945572.572380:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945572.958493:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945572.958526:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254762496 00000100:00100000:2.0:1790945572.958536:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254762496 00000100:00100000:2.0:1790945572.958581:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 138 00000100:00100000:2.0:1790945572.958589:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:11319:x1877942254762496:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945572.958610:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945572.958628:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fb3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c831a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.958727:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.958741:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.958751:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.958774:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fb48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.958780:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fb48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.958786:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fb48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.958980:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.958987:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.958993:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.958997:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434afa00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945572.959002:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.959009:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.959020:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb845042600) 00010000:00010000:2.0:1790945572.959023:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945572.959027:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.959032:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fb41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.959048:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fb48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.959053:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fb48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.959058:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fb48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.959062:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945572.959065:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fb48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.959070:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fb48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.959076:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bb845042400) 00010000:00010000:2.0:1790945572.959077:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945572.959080:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fb48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.959085:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fb48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.959112:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fb3a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c831a expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.959120:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb845042600) 00010000:00010000:2.0:1790945572.959123:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945572.959131:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fb3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c831a expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945572.959141:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434af600, rc 0) 00000100:00100000:2.0:1790945572.959200:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:11319:x1877942254762496:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 611us (716us total) trans 0 rc 301/301 00000100:00100000:2.0:1790945572.959207:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 138 00000100:00100000:2.0:1790945572.964645:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945572.964766:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254762752 00000100:00100000:3.0:1790945572.964776:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254762752 00000100:00100000:3.0:1790945572.964830:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 139 00000100:00100000:3.0:1790945572.964852:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:11319:x1877942254762752:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:3.0:1790945572.964905:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945572.964931:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54f4c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c815a expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.964964:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb845042600) 00010000:00010000:3.0:1790945572.964975:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945572.965171:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb4f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.965185:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.965195:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.965206:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb56 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.965212:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.965218:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945572.966118:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790945572.966132:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.966140:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb4f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.966146:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb4f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.966152:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945572.966163:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb4f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.966170:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb4f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.966181:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb85a4d2800) 00010000:00010000:3.0:1790945572.966184:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945572.966187:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb4f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.966193:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb4f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790945572.966213:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003e364f4f reply state 00000000528c322d transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945572.966221:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945572.966313:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:11319:x1877942254762752:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 1472us (1673us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1790945572.966322:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 139 00010000:00010000:3.0:1790945572.970770:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.970788:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb56 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.970796:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb56 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.970803:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945572.970808:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb56 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.970824:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb56 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.970848:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bb85a4d2d00) 00010000:00010000:3.0:1790945572.970852:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945572.970858:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb56 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945572.970865:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb56 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945573.077352:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945573.077530:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254762880 00000100:00100000:1.0:1790945573.077541:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254762880 00000100:00100000:1.0:1790945573.077616:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 140 00000100:00100000:1.0:1790945573.077627:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:11327:x1877942254762880:12345-192.168.202.48@tcp:101:lctl.0 00010000:00010000:1.0:1790945573.077652:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1790945573.078071:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790945573.078284:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8321 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.078425:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.078439:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.078450:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945573.078484:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790945573.078488:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790945573.078511:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.078536:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8321 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.078574:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8321 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.078583:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb85a4d2d00) 00010000:00010000:3.0:1790945573.078587:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945573.078590:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840031400, rc 0) 00000100:00100000:3.0:1790945573.080274:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:11327:x1877942254762880:12345-192.168.202.48@tcp:101:lctl.0 Request processed in 1030us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945573.080304:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 140 00000100:00100000:2.0:1790945573.149926:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945573.150036:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254763008 00000100:00100000:3.0:1790945573.150048:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254763008 00000100:00100000:3.0:1790945573.150225:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 141 00000100:00100000:3.0:1790945573.150240:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+15:11333:x1877942254763008:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:3.0:1790945573.150261:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945573.150282:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8328 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150357:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fb72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150373:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fb72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150385:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fb72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150398:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fb79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150418:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fb79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150425:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fb79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150528:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54fb80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150537:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150544:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945573.150569:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790945573.150572:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790945573.150590:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150602:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fb72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150608:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fb72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150614:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fb72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150619:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031c00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945573.150624:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fb72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150637:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fb72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150648:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb85a4d2d00) 00010000:00010000:3.0:1790945573.150651:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945573.150677:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fb72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150683:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fb72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150734:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fb79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.150741:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fb79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.151068:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fb79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.151085:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945573.151089:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fb79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.151095:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fb79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.151104:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bb85a4d2800) 00010000:00010000:3.0:1790945573.151106:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945573.151109:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fb79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.151124:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fb79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.151164:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fb6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8328 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.151180:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54fb80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8328 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.151187:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:3.0:1790945573.151189:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790945573.151192:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030400, rc 0) 00000100:00100000:3.0:1790945573.151266:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:11333:x1877942254763008:12345-192.168.202.48@tcp:101:bash.0 Request processed in 1031us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945573.151274:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 141 00000100:00100000:2.0:1790945573.158542:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945573.158684:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254763264 00000100:00100000:1.0:1790945573.158705:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254763264 00000100:00100000:1.0:1790945573.158775:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 142 00000100:00100000:1.0:1790945573.158785:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+16:11333:x1877942254763264:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:1.0:1790945573.158805:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945573.158824:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fb87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c832f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.158951:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fb8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.158967:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fb8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.158996:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fb8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.159059:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.159067:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.159086:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790945573.160398:0:5825:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1790945573.163196:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.163219:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.163230:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.163290:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fb8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.163445:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fb8e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.163452:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fb8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.163509:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945573.163526:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fb8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.163534:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fb8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.163547:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:1.0:1790945573.163550:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945573.163554:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fb8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.163561:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fb8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790945573.163573:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000849ebae9 reply state 000000009455dd1b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945573.163581:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790945573.163628:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fb87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c832f expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.163643:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c832f expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.163650:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765900) 00010000:00010000:1.0:1790945573.163652:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945573.163954:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132c00, rc 0) 00000100:00100000:1.0:1790945573.164093:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:11333:x1877942254763264:12345-192.168.202.48@tcp:101:bash.0 Request processed in 5308us (5558us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1790945573.164102:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 142 00010000:00010000:3.0:1790945573.168304:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.168323:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.168331:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.168336:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133a00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945573.168342:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.168349:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.168379:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb843765500) 00010000:00010000:3.0:1790945573.168382:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945573.168386:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.168392:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fb95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945573.171126:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945573.171347:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254763392 00000100:00100000:0.0:1790945573.171358:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254763392 00000100:00100000:0.0:1790945573.171421:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 47 00000100:00100000:0.0:1790945573.171431:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2372:x1877942254763392:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1790945573.171453:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945573.171475:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcc9ed0d/0xc5cf2c2a6a54fbaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8336 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790945573.171520:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790945573.171541:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=318s v=(0 0) 00010000:00010000:0.0:1790945573.171547:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945573.171555:0:6672:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc9ed0d/0xc5cf2c2a6a54fbaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8336 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.171573:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bcc9ed0d/0xc5cf2c2a6a54fbaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8336 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.171588:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1ca00, rc 0) 00000100:00100000:0.0:1790945573.171649:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254763392:12345-192.168.202.48@tcp:101:bash.0 Request processed in 218us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945573.171686:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 47 00000100:00100000:2.0:1790945573.179389:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945573.179561:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254763520 00000100:00100000:0.0:1790945573.179571:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254763520 00000100:00100000:0.0:1790945573.179861:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 48 00000100:00100000:0.0:1790945573.179872:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:11333:x1877942254763520:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1790945573.179893:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945573.179912:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c833d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.179944:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bcc9ed0d/0xc5cf2c2a6a54fbaa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8336 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.179987:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945573.179991:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945573.179998:0:6670:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.180034:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bcc9ed0d/0xc5cf2c2a6a54fbaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8336 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.180049:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bcc9ed0d/0xc5cf2c2a6a54fbaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8336 expref: 7 pid: 6672 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945573.180063:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874acb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1877942273645184:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945573.180164:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842a8b480 going to sleep for 11 seconds 00000100:00100000:3.0:1790945573.185373:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874acb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1877942273645184:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945573.185409:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.185428:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1da00, rc 0) 00000100:00100000:3.0:1790945573.185490:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:11333:x1877942254763520:12345-192.168.202.48@tcp:101:bash.0 Request processed in 5619us (6109us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945573.185499:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 48 00000100:00100000:2.0:1790945573.194280:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945573.194818:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254763648 00000100:00100000:3.0:1790945573.194830:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254763648 00010000:00010000:3.0:1790945573.194870:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc9ed0d/0xc5cf2c2a6a54fbaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8336 expref: 7 pid: 6672 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945573.194919:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 59 00000100:00100000:3.0:1790945573.194935:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2373:x1877942254763648:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945573.194951:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945573.194973:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bcc9ed0d/0xc5cf2c2a6a54fbaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8336 expref: 7 pid: 6672 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.195006:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bcc9ed0d/0xc5cf2c2a6a54fbaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8336 expref: 7 pid: 6672 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.195030:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcc9ed0d/0xc5cf2c2a6a54fbaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8336 expref: 7 pid: 6672 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.195046:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945573.195050:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945573.195058:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.195069:0:5809:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.195105:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945573.195120:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88135d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5809:1877942273645312:192.168.202.48@tcp:105: 00000100:00100000:3.0:1790945573.195491:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb873895240 going to sleep for 11 seconds 00000100:00100000:3.0:1790945573.203427:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88135d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5809:1877942273645312:192.168.202.48@tcp:105: 00010000:00010000:3.0:1790945573.203454:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945573.203512:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254763648:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8578us (9241us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945573.203524:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 59 00000100:00100000:2.0:1790945573.206924:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945573.207593:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254763904 00000100:00100000:3.0:1790945573.207605:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254763904 00000100:00100000:1.0:1790945573.208225:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00100000:1.0:1790945573.208238:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+18:11333:x1877942254763904:12345-192.168.202.48@tcp:35:bash.0 00000100:00100000:0.0:1790945573.208819:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:11333:x1877942254763904:12345-192.168.202.48@tcp:35:bash.0 Request processed in 581us (1901us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1790945573.208828:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00100000:2.0:1790945573.366096:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945573.366285:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254764160 00000100:00100000:0.0:1790945573.366296:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254764160 00000100:00100000:0.0:1790945573.366354:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 143 00000100:00100000:0.0:1790945573.366364:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:11343:x1877942254764160:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945573.366388:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945573.366409:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fbb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8344 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945573.366520:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790945573.366637:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fbb8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8344 expref: 21 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.366651:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb85a4d2d00) 00010000:00010000:0.0:1790945573.366654:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945573.367044:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fbb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8344 expref: 21 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.367061:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c000, rc 0) 00000100:00100000:0.0:1790945573.367138:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:11343:x1877942254764160:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 776us (1051us total) trans 4294967420 rc 301/301 00000100:00100000:0.0:1790945573.367147:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 143 00000100:00100000:2.0:1790945573.379475:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945573.379557:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254764416 00000100:00100000:3.0:1790945573.379567:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254764416 00000100:00100000:3.0:1790945573.379622:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 37 00000100:00100000:3.0:1790945573.379633:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:11343:x1877942254764416:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1790945573.380018:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:11343:x1877942254764416:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 385us (549us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1790945573.380027:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 37 00000100:00100000:2.0:1790945573.481014:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945573.481172:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254764544 00000100:00100000:3.0:1790945573.481183:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254764544 00000100:00100000:3.0:1790945573.481303:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 144 00000100:00100000:3.0:1790945573.481314:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:11349:x1877942254764544:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945573.481337:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945573.481357:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fbc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c834b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.481421:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fbcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.481435:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fbcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.481464:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fbcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945573.481498:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790945573.481502:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790945573.481519:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fbcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.481571:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fbc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c834b expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.481591:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fbcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c834b expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.481600:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:3.0:1790945573.481603:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945573.481606:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840031600, rc 0) 00000100:00100000:3.0:1790945573.481720:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:11349:x1877942254764544:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 407us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945573.481728:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 144 00000100:00100000:2.0:1790945573.486141:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945573.486212:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254764800 00000100:00100000:3.0:1790945573.486223:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254764800 00000100:00100000:3.0:1790945573.486279:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 145 00000100:00100000:3.0:1790945573.486356:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:11349:x1877942254764800:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945573.486378:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945573.486400:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fbd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8352 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.487034:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fbdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.487049:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fbdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.487060:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fbdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945573.487084:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790945573.487213:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fbd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8352 expref: 25 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.487233:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fbdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8352 expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.487243:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765900) 00010000:00010000:3.0:1790945573.487246:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945573.487250:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030000, rc 0) 00000100:00100000:3.0:1790945573.488455:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+24:11349:x1877942254764800:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2162us (2317us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1790945573.488466:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 145 00000100:00100000:2.0:1790945573.494965:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945573.495096:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254765056 00000100:00100000:1.0:1790945573.495105:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254765056 00000100:00100000:1.0:1790945573.495194:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 146 00000100:00100000:1.0:1790945573.495203:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb872fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+24:11349:x1877942254765056:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1790945573.495235:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945573.495253:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fbe9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8359 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.495355:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fbf0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.495370:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fbf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.495380:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fbf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945573.495391:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790945573.495523:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fbe9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8359 expref: 27 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.495550:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fbf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8359 expref: 26 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.495559:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765900) 00010000:00010000:1.0:1790945573.495562:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790945573.495579:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132800, rc 0) 00000100:00100000:1.0:1790945573.495644:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb872fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+26:11349:x1877942254765056:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 441us (688us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1790945573.495652:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 146 00000100:00100000:2.0:1790945573.497759:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945573.497841:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254765184 00000100:00100000:3.0:1790945573.497849:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254765184 00000100:00100000:3.0:1790945573.497962:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:3.0:1790945573.497971:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+26:2371:x1877942254765184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945573.497986:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945573.498242:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fbdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8352 expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.498263:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765900) 00010000:00010000:3.0:1790945573.498268:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945573.498366:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:2371:x1877942254765184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 396us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945573.498375:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:2.0:1790945573.510780:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945573.511682:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254765312 00000100:00100000:0.0:1790945573.511705:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254765312 00000100:00100000:0.0:1790945573.511766:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 49 00000100:00100000:0.0:1790945573.511776:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2370:x1877942254765312:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1790945573.511821:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.511841:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.511849:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790945573.511854:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790945573.511872:0:6672:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.511909:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.511924:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 6 pid: 6670 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945573.511937:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874ac8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1877942273645440:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945573.512036:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842a8b480 going to sleep for 11 seconds 00000100:00100000:2.0:1790945573.518903:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945573.519223:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874ac8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1877942273645440:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945573.519253:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945573.520297:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254765440 00000100:00100000:3.0:1790945573.520309:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254765440 00002000:00100000:3.0:1790945573.520365:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9bb873a35180 x1877942254765440/t0(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:269/0 lens 504/0 e 0 to 0 dl 1790945584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945573.520377:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb873a35180 with x1877942254765440 ext(0->12) 00010000:00010000:3.0:1790945573.520385:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 7 pid: 6670 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.520402:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 7 pid: 6670 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945573.520410:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bb873a35180 00000100:00100000:1.0:1790945573.520554:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:1.0:1790945573.520567:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2373:x1877942254765440:12345-192.168.202.48@tcp:4:lfs.0 00000100:00100000:1.0:1790945573.521119:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2373:x1877942254765440:12345-192.168.202.48@tcp:4:lfs.0 Request processed in 552us (2224us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790945573.521127:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2 00002000:00100000:1.0:1790945573.521135:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9bb873a35180 x1877942254765440/t4294967305(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:269/0 lens 504/448 e 0 to 0 dl 1790945584 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945573.521144:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb873a35180 with x1877942254765440 ext(0->12) 00010000:00010000:1.0:1790945573.521150:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 9 pid: 6670 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.521173:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 9 pid: 6670 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790945573.521182:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bb873a35180 00000100:00100000:2.0:1790945573.530830:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945573.530980:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254765568 00000100:00100000:1.0:1790945573.530990:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254765568 00010000:00010000:1.0:1790945573.531036:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 9 pid: 6670 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945573.531128:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 60 00000100:00100000:1.0:1790945573.531138:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2371:x1877942254765568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945573.531180:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790945573.531200:0:5808:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790945573.531203:0:5808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790945573 00002000:00010000:1.0:1790945573.531205:0:5808:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790945573 00002000:00010000:1.0:1790945573.531207:0:5808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790945573 00010000:00010000:1.0:1790945573.531214:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 9 pid: 6670 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.531228:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 9 pid: 6670 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.531254:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008430b785/0xc5cf2c2a6a54fbb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c833d expref: 9 pid: 6670 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.531274:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790945573.531279:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790945573.531284:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.531305:0:5808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.531340:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945573.531392:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2371:x1877942254765568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 256us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945573.531400:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 60 00010000:00010000:0.0:1790945573.531479:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.531489:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.531514:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.531523:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.531550:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.531558:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945573.531562:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.531572:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.531585:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.531592:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001330aa66/0xc5cf2c2a6a54fbfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945573.531635:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2370:x1877942254765312:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 19860us (20866us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945573.531643:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 49 00000100:00100000:2.0:1790945573.535013:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945573.535101:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254765824 00000100:00100000:3.0:1790945573.535111:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254765824 00000100:00100000:3.0:1790945573.535278:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 38 00000100:00100000:3.0:1790945573.535299:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8477f0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:11349:x1877942254765824:12345-192.168.202.48@tcp:35:lfs.0 00000004:00010000:3.0:1790945573.535360:0:5827:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fbf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8359 expref: 25 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945573.540434:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1790945573.540508:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1790945573.544786:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:3.0:1790945573.545967:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.545991:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c832f expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.546020:0:5827:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.546063:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c832f expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.546080:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c832f expref: 29 pid: 5825 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945573.546095:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88135f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5827:1877942273645568:192.168.202.48@tcp:104: 00000100:00100000:3.0:1790945573.546251:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8738959c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945573.555584:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945573.555849:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88135f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5827:1877942273645568:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945573.555890:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945573.559251:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254765952 00000100:00100000:1.0:1790945573.559265:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254765952 00010000:00010000:1.0:1790945573.559312:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c832f expref: 30 pid: 5825 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945573.560311:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:1.0:1790945573.560324:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:2372:x1877942254765952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945573.560342:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945573.560350:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c832f expref: 30 pid: 5825 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.560364:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c832f expref: 30 pid: 5825 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.560385:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fb9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c832f expref: 30 pid: 5825 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.560401:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765900) 00010000:00010000:1.0:1790945573.560406:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.560415:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.560422:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945573.560462:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945573.560524:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:2372:x1877942254765952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 203us (4950us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945573.560545:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 61 00010000:00010000:3.0:1790945573.560611:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.560619:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945573.560783:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1790945573.560997:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1790945573.561100:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88135f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877942273645696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790945573.561154:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945573.561193:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8738953c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945573.561839:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273645696 00000100:00100000:0.0:1790945573.561847:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273645696 00000100:00100000:0.0:1790945573.561918:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790945573.561927:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5827:x1877942273645696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790945573.562000:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5827:x1877942273645696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945573.562021:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1790945573.562908:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945573.562957:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88135f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877942273645696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790945573.563815:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1790945573.563952:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88135f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877942273645824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790945573.564004:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945573.564030:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881633300 going to sleep for 11 seconds 00000100:00100000:0.0:1790945573.564865:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273645824 00000100:00100000:0.0:1790945573.564885:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273645824 00000100:00100000:0.0:1790945573.564930:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790945573.564937:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5827:x1877942273645824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790945573.565118:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5827:x1877942273645824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 180us (1112us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790945573.565125:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790945573.566310:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88135f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5827:1877942273645824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790945573.566385:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1790945573.566435:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.566593:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.566600:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.566607:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945573.566612:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.566620:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.566644:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765900) 00010000:00010000:3.0:1790945573.566647:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790945573.566652:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.566679:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc05 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790945573.568341:0:5827:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790945573.568988:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1790945573.569003:0:5827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319364345607ns, next at 320364342192ns, rc = 0 00000001:00080000:3.0:1790945573.569015:0:5827:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1790945573.569073:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765900) 00010000:00010000:3.0:1790945573.569077:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790945573.569088:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fbf0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8359 expref: 33 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945573.569585:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8477f0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+32:11349:x1877942254765824:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 34294us (34576us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1790945573.569595:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 38 00000020:00080000:3.0:1790945573.569601:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790945573.575337:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945573.575418:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254766080 00000100:00100000:0.0:1790945573.575428:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254766080 00000100:00100000:0.0:1790945573.575493:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 147 00000100:00100000:0.0:1790945573.575502:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+32:11349:x1877942254766080:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945573.575526:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945573.575546:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fc0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8360 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.575607:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fc0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8360 expref: 33 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.575621:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fc0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8360 expref: 33 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.575651:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:0.0:1790945573.575826:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790945573.575831:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c200, rc 0) 00000100:00100000:0.0:1790945573.575943:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:11349:x1877942254766080:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 441us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945573.575962:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 147 00000100:00100000:2.0:1790945573.593647:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945573.594299:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254766336 00000100:00100000:0.0:1790945573.594311:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254766336 00000100:00100000:0.0:1790945573.594368:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 39 00000100:00100000:0.0:1790945573.594378:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:11349:x1877942254766336:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1790945573.594608:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+34:11349:x1877942254766336:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 230us (979us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1790945573.594615:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 39 00010000:00010000:0.0:1790945573.600800:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945573.727862:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945573.727945:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254766592 00000100:00100000:3.0:1790945573.727955:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254766592 00000100:00100000:3.0:1790945573.728016:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 148 00000100:00100000:3.0:1790945573.728026:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+34:11359:x1877942254766592:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945573.728049:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945573.728068:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8367 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945573.728156:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790945573.728406:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc13 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8367 expref: 36 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.728420:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb85a4d2d00) 00010000:00010000:3.0:1790945573.728439:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945573.728446:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8367 expref: 36 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.728462:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030000, rc 0) 00000100:00100000:3.0:1790945573.728575:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:11359:x1877942254766592:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 549us (723us total) trans 4294967434 rc 301/301 00000100:00100000:3.0:1790945573.728583:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 148 00000100:00100000:2.0:1790945573.739807:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945573.741074:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254766720 00000100:00100000:3.0:1790945573.741088:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254766720 00000100:00100000:3.0:1790945573.741150:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 149 00000100:00100000:3.0:1790945573.741166:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:11359:x1877942254766720:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:3.0:1790945573.741234:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741250:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741261:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741274:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741280:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741286:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741362:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fc2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741381:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fc2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741388:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fc2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790945573.741427:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fc2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741438:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741445:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741452:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741458:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945573.741462:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741469:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741479:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:3.0:1790945573.741482:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945573.741486:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741492:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741509:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741516:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741522:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741526:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031c00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945573.741529:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741535:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741541:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb85a4d2800) 00010000:00010000:3.0:1790945573.741543:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945573.741546:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741551:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741567:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fc2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741573:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fc2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741579:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fc2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741587:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945573.741590:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fc2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741596:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fc2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741602:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:3.0:1790945573.741604:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945573.741607:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fc2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.741612:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fc2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945573.741738:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:11359:x1877942254766720:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 579us (1940us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945573.741745:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 149 00000100:00100000:2.0:1790945573.744380:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945573.744475:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254766976 00000100:00100000:0.0:1790945573.744485:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254766976 00000100:00100000:0.0:1790945573.744538:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 40 00000100:00100000:0.0:1790945573.744548:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:11359:x1877942254766976:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1790945573.744827:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:11359:x1877942254766976:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 280us (456us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1790945573.744836:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 40 00000100:00100000:2.0:1790945573.791790:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945573.792728:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254767232 00000100:00100000:3.0:1790945573.792739:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254767232 00000100:00100000:3.0:1790945573.792958:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 150 00000100:00100000:3.0:1790945573.792969:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:11362:x1877942254767232:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945573.792992:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945573.793011:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fc36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c836e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793092:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793124:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793136:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793151:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793170:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793177:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793290:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fc4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793299:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fc4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793306:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fc4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945573.793315:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790945573.793402:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793410:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793416:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793428:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031c00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945573.793432:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793439:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793450:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:3.0:1790945573.793454:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945573.793458:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793464:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fc3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793481:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793487:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793492:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793497:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945573.793500:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793506:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793524:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb85a4d2800) 00010000:00010000:3.0:1790945573.793527:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945573.793530:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793536:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fc44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793579:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fc36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c836e expref: 39 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793592:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fc4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c836e expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945573.793599:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:3.0:1790945573.793601:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945573.793603:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840031200, rc 0) 00000100:00100000:3.0:1790945573.793728:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+38:11362:x1877942254767232:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 760us (1947us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1790945573.793736:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 150 00000100:00100000:0.0:1790945573.799997:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945573.800470:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254767360 00000100:00100000:3.0:1790945573.800481:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254767360 00000100:00100000:0.0:1790945573.800638:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 151 00000100:00100000:0.0:1790945573.800648:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+38:11362:x1877942254767360:12345-192.168.202.48@tcp:54:lfs.0 00010000:00010000:0.0:1790945573.800746:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.800764:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.800774:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.800813:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.800820:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.800827:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.800832:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945573.800836:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.800843:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.800854:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:0.0:1790945573.800857:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945573.800861:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945573.800866:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945573.800953:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+38:11362:x1877942254767360:12345-192.168.202.48@tcp:54:lfs.0 Request processed in 306us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945573.800960:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 151 00000100:00100000:2.0:1790945573.804653:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945573.805089:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254767616 00000100:00100000:1.0:1790945573.805101:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254767616 00000100:00100000:1.0:1790945573.805156:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 41 00000100:00100000:1.0:1790945573.805166:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+38:11362:x1877942254767616:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:1.0:1790945573.805553:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+39:11362:x1877942254767616:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 387us (907us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1790945573.805561:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 41 00000100:00100000:2.0:1790945574.099024:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945574.099139:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254767872 00000100:00100000:1.0:1790945574.099149:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254767872 00000100:00100000:1.0:1790945574.099211:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 152 00000100:00100000:1.0:1790945574.099222:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+39:11392:x1877942254767872:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1790945574.099261:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945574.099281:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fc60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8375 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.099379:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fc67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.099399:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.099411:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945574.099423:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790945574.099555:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fc60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8375 expref: 42 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.099593:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fc67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8375 expref: 41 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.099602:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:1.0:1790945574.099605:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945574.099609:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132200, rc 0) 00000100:00100000:1.0:1790945574.099745:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:11392:x1877942254767872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 525us (729us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1790945574.099753:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 152 00000100:00100000:0.0:1790945574.102953:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945574.103042:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254768128 00000100:00100000:3.0:1790945574.103060:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254768128 00000100:00100000:3.0:1790945574.103115:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 42 00000100:00100000:3.0:1790945574.103313:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:11392:x1877942254768128:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1790945574.103582:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945574.103708:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+42:11392:x1877942254768128:12345-192.168.202.48@tcp:35:cat.0 Request processed in 584us (762us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1790945574.103731:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 42 00000100:00100000:0.0:1790945574.111303:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254768256 00000100:00100000:0.0:1790945574.111318:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254768256 00000100:00100000:0.0:1790945574.111407:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:0.0:1790945574.111419:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+42:2370:x1877942254768256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945574.111436:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945574.111460:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fc67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8375 expref: 42 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.111627:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:0.0:1790945574.111634:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945574.111733:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:2370:x1877942254768256:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 316us (8151us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945574.111742:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:1.0:1790945574.169653:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945574.169867:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254768512 00000100:00100000:0.0:1790945574.169877:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254768512 00000100:00100000:0.0:1790945574.170044:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 153 00000100:00100000:0.0:1790945574.170055:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:11399:x1877942254768512:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1790945574.170079:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945574.170083:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790945574.170108:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a54fbcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c834b expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.170131:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:0.0:1790945574.170135:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945574.170148:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c837c expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.170239:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.170269:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fc4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c836e expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.170278:0:7211:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.170311:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fc4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c836e expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.170325:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fc4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c836e expref: 41 pid: 5824 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945574.170339:0:7211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874acb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273645952:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945574.170548:0:7211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb845e00d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790945574.174284:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945574.174377:0:7211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874acb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273645952:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945574.174402:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945574.174529:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254768640 00000100:00100000:1.0:1790945574.174536:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254768640 00010000:00010000:1.0:1790945574.174569:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fc4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c836e expref: 42 pid: 5824 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945574.174607:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:1.0:1790945574.174616:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+42:2373:x1877942254768640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945574.174629:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945574.174636:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fc4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c836e expref: 42 pid: 5824 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.174648:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fc4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c836e expref: 42 pid: 5824 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.174884:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fc4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c836e expref: 42 pid: 5824 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.174927:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:1.0:1790945574.174933:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.174942:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.174951:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.174983:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945574.175037:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:2373:x1877942254768640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 421us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945574.175045:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 62 00010000:00010000:2.0:1790945574.175628:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.175639:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945574.175701:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790945574.175847:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c837c expref: 42 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.175863:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c837c expref: 41 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.175884:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:2.0:1790945574.175887:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790945574.175890:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d600, rc 0) 00000100:00100000:2.0:1790945574.175942:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:11399:x1877942254768512:12345-192.168.202.48@tcp:101:dd.0 Request processed in 5889us (6296us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1790945574.175949:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 153 00000100:00100000:2.0:1790945574.180122:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945574.180398:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254768896 00000100:00100000:1.0:1790945574.180409:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254768896 00000100:00100000:1.0:1790945574.180472:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 154 00000100:00100000:1.0:1790945574.180482:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:11399:x1877942254768896:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:1.0:1790945574.180787:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fc8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.180803:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fc8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.180814:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fc8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945574.180868:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:1.0:1790945574.180905:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a3f9882b reply state 000000002cbb8344 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fc8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945574.180927:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790945574.181023:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+44:11399:x1877942254768896:12345-192.168.202.48@tcp:36:dd.0 Request processed in 541us (908us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1790945574.181031:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 154 00000020:00080000:1.0:1790945574.181036:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790945574.183224:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fc8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.183239:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fc8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.183247:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fc8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.183252:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945574.183257:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fc8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.183263:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fc8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.183279:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:3.0:1790945574.183282:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945574.183287:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fc8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.183293:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fc8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945574.471474:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945574.471692:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254769024 00000100:00100000:0.0:1790945574.471704:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254769024 00000100:00100000:0.0:1790945574.471764:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 155 00000100:00100000:0.0:1790945574.471774:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+43:11413:x1877942254769024:12345-192.168.202.48@tcp:101:stat.0 00010000:00010000:0.0:1790945574.471798:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945574.471816:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8383 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.471884:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fc98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.471903:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fc98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.471926:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fc98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.471942:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fc9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.471948:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fc9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.471954:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fc9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.472037:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fca6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.472047:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c837c expref: 44 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.472054:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fca6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.472084:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c837c expref: 44 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.472097:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c837c expref: 44 pid: 7211 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945574.472122:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb874acb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273646080:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945574.472217:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb845e00d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790945574.482328:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb874acb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273646080:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945574.482356:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fca6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945574.482834:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945574.482897:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254769280 00000100:00100000:1.0:1790945574.482905:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254769280 00000100:00100000:1.0:1790945574.482963:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 43 00000100:00100000:1.0:1790945574.482971:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+45:5613:x1877942254769280:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790945574.483246:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+46:5613:x1877942254769280:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 275us (413us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1790945574.483254:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 43 00000100:00100000:1.0:1790945574.489812:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945574.494429:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254769408 00000100:00100000:2.0:1790945574.494505:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254769408 00010000:00010000:2.0:1790945574.494557:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c837c expref: 46 pid: 7211 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945574.494695:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:2.0:1790945574.494706:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+46:2373:x1877942254769408:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945574.494721:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945574.494728:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c837c expref: 46 pid: 7211 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.494740:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c837c expref: 46 pid: 7211 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.494762:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fc7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c837c expref: 46 pid: 7211 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.494780:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:2.0:1790945574.494784:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fca6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.494793:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.494800:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fca6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.494828:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945574.494928:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+45:2373:x1877942254769408:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 223us (5124us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945574.494936:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 63 00010000:00010000:1.0:1790945574.495004:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495013:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945574.495059:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790945574.495064:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790945574.495088:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495100:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495109:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fc98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495123:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fc98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495129:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fc98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495134:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945574.495139:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fc98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495147:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fc98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495156:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:1.0:1790945574.495158:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945574.495162:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fc98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495167:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fc98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495177:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fc9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495182:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fc9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495188:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fc9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495192:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945574.495202:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fc9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495207:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fc9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495216:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb8510c8c00) 00010000:00010000:1.0:1790945574.495218:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945574.495220:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fc9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495225:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fc9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495273:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fc91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8383 expref: 45 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495286:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8383 expref: 44 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.495293:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:1.0:1790945574.495295:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945574.495297:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1da00, rc 0) 00000100:00100000:1.0:1790945574.495324:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+44:11413:x1877942254769024:12345-192.168.202.48@tcp:101:stat.0 Request processed in 23552us (23860us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945574.495331:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 155 00000100:00100000:0.0:1790945574.550810:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945574.550906:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254769664 00000100:00100000:3.0:1790945574.550917:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254769664 00000100:00100000:3.0:1790945574.550981:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 156 00000100:00100000:3.0:1790945574.550993:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+44:11419:x1877942254769664:12345-192.168.202.48@tcp:36:truncate.0 00010000:00010000:3.0:1790945574.551054:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945574.551094:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fca6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8383 expref: 44 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.551115:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:3.0:1790945574.551120:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945574.551365:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fcad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.551381:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fcad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.551391:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fcad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945574.551453:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:3.0:1790945574.551479:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b9d49169 reply state 00000000cec97f8d transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fcad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945574.551488:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945574.551589:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+46:11419:x1877942254769664:12345-192.168.202.48@tcp:36:truncate.0 Request processed in 597us (787us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1790945574.551597:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 156 00000020:00080000:3.0:1790945574.551602:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790945574.553914:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fcad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.553944:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fcad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.553971:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fcad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.553978:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945574.553984:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fcad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.553993:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fcad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.554012:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:1.0:1790945574.554024:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945574.554031:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fcad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.554038:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fcad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.621202:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945574.732258:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945574.732395:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254769792 00000100:00100000:2.0:1790945574.732409:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254769792 00000100:00100000:2.0:1790945574.732482:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 157 00000100:00100000:2.0:1790945574.732494:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+45:11433:x1877942254769792:12345-192.168.202.48@tcp:101:stat.0 00010000:00010000:2.0:1790945574.732526:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945574.732549:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fcb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c838a expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.732632:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fcbb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.732650:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fcbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.732711:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fcbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.732735:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fcc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.732743:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.732751:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.732861:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fcc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.732892:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.732906:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945574.732951:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1790945574.732955:0:7211:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945574.732980:0:7211:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.732993:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733003:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fcbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733010:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fcbb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733017:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fcbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733023:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945574.733027:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fcbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733036:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fcbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733050:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:2.0:1790945574.733060:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945574.733067:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fcbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733073:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fcbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733089:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733095:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fcc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733101:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fcc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733106:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434aee00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945574.733109:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fcc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733115:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fcc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733122:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb845042400) 00010000:00010000:2.0:1790945574.733125:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945574.733128:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fcc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733133:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fcc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733168:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fcb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c838a expref: 47 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733192:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fcc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c838a expref: 46 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945574.733199:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:2.0:1790945574.733201:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945574.733204:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434ae400, rc 0) 00000100:00100000:2.0:1790945574.733286:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+46:11433:x1877942254769792:12345-192.168.202.48@tcp:101:stat.0 Request processed in 794us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945574.733295:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 157 00000100:00100000:3.0:1790945574.822838:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945574.823125:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254770048 00000100:00100000:0.0:1790945574.823138:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254770048 00000100:00100000:0.0:1790945574.823203:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 158 00000100:00100000:0.0:1790945574.823216:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88165f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+46:11443:x1877942254770048:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945574.823243:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945574.823269:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fcd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8391 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945574.823386:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790945574.823539:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fcd0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8391 expref: 48 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.823556:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb85a4d2d00) 00010000:00010000:0.0:1790945574.823559:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945574.823565:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fcd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8391 expref: 48 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.823603:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d400, rc 0) 00000100:00100000:0.0:1790945574.823836:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88165f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+47:11443:x1877942254770048:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 621us (1010us total) trans 4294967446 rc 301/301 00000100:00100000:0.0:1790945574.823845:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 158 00000100:00100000:1.0:1790945574.828883:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945574.829038:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254770304 00000100:00100000:0.0:1790945574.829137:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254770304 00000100:00100000:0.0:1790945574.829258:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 44 00000100:00100000:0.0:1790945574.829270:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8477f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+47:11443:x1877942254770304:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1790945574.829589:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8477f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+48:11443:x1877942254770304:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 320us (715us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1790945574.829598:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 44 00000100:00100000:1.0:1790945574.884975:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945574.885458:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254770560 00000100:00100000:0.0:1790945574.885472:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254770560 00000100:00100000:0.0:1790945574.885607:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 159 00000100:00100000:0.0:1790945574.885622:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+48:11449:x1877942254770560:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1790945574.885654:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945574.885728:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fcde lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8398 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.885871:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.885889:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fcc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c838a expref: 49 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.885938:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.885982:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fcc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c838a expref: 49 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.885998:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fcc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c838a expref: 49 pid: 7211 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945574.886015:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273646208:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945574.886410:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb845e00f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945574.888563:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945574.888624:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254770688 00000100:00100000:3.0:1790945574.888635:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254770688 00010000:00010000:3.0:1790945574.888703:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fcc9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c838a expref: 50 pid: 7211 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945574.888775:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:3.0:1790945574.888784:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+50:2373:x1877942254770688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945574.888814:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945574.888820:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fcc9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c838a expref: 50 pid: 7211 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.888831:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fcc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c838a expref: 50 pid: 7211 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.888854:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:3.0:1790945574.888865:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.888874:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.888880:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.888898:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945574.888964:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+50:2373:x1877942254770688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 180us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945574.888977:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 64 00010000:00010000:0.0:1790945574.889111:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fcc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c838a expref: 49 pid: 7211 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945574.889126:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273646208:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945574.889146:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.889153:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.889158:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945574.889178:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1790945574.889346:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fcde lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8398 expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.889375:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8398 expref: 49 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.889384:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:0.0:1790945574.889388:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790945574.889390:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1da00, rc 0) 00000100:00100000:0.0:1790945574.889435:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+49:11449:x1877942254770560:12345-192.168.202.48@tcp:101:bash.0 Request processed in 3817us (4477us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1790945574.889442:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 159 00000100:00100000:2.0:1790945574.892312:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945574.892389:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254770944 00000100:00100000:1.0:1790945574.892402:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254770944 00000100:00100000:1.0:1790945574.892498:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 160 00000100:00100000:1.0:1790945574.892509:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+49:11449:x1877942254770944:12345-192.168.202.48@tcp:36:bash.0 00010000:00010000:1.0:1790945574.892964:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fcf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.892986:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.893021:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945574.893157:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:1.0:1790945574.893185:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f4606769 reply state 000000004015eed2 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945574.893196:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790945574.893314:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+52:11449:x1877942254770944:12345-192.168.202.48@tcp:36:bash.0 Request processed in 805us (1011us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1790945574.893322:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 160 00000020:00080000:1.0:1790945574.893328:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790945574.895444:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.895467:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fcf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.895476:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fcf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.895500:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945574.895507:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fcf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.895516:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fcf3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.895537:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:3.0:1790945574.895541:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945574.895547:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fcf3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.895554:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fcf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945574.898148:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945574.898257:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254771072 00000100:00100000:0.0:1790945574.898270:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254771072 00000100:00100000:0.0:1790945574.898348:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 161 00000100:00100000:0.0:1790945574.898360:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+51:11449:x1877942254771072:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1790945574.898394:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945574.898421:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fcfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c839f expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.898534:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fd01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.898552:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8398 expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.898562:0:7211:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fd01 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.898606:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8398 expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.898642:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8398 expref: 52 pid: 5823 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945574.898955:0:7211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87f9b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273646336:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945574.899840:0:7211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb86c96b000 going to sleep for 11 seconds 00000100:00100000:2.0:1790945574.902182:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945574.902299:0:7211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87f9b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273646336:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945574.902332:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fd01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945574.902391:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254771200 00000100:00100000:3.0:1790945574.902402:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254771200 00010000:00010000:3.0:1790945574.902449:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8398 expref: 53 pid: 5823 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945574.902529:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:3.0:1790945574.902540:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+53:2372:x1877942254771200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945574.902557:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945574.902564:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8398 expref: 53 pid: 5823 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.902577:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8398 expref: 53 pid: 5823 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.902627:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fce5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8398 expref: 53 pid: 5823 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.902647:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:3.0:1790945574.902652:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fd01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.902721:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fd01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.902731:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fd01 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945574.902764:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945574.902840:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+52:2372:x1877942254771200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 301us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945574.902849:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 65 00010000:00010000:0.0:1790945574.903067:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fd01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.903076:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fd01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945574.903140:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790945574.903145:0:7211:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945574.903172:0:7211:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fd01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.903209:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fcfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c839f expref: 53 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.903227:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fd01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c839f expref: 52 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.903235:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:0.0:1790945574.903247:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945574.903251:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d600, rc 0) 00000100:00100000:0.0:1790945574.903285:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+52:11449:x1877942254771072:12345-192.168.202.48@tcp:101:bash.0 Request processed in 4927us (5153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945574.903292:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 161 00000100:00100000:2.0:1790945574.906843:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945574.907001:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254771456 00000100:00100000:3.0:1790945574.907013:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254771456 00000100:00100000:3.0:1790945574.907131:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 45 00000100:00100000:3.0:1790945574.907144:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+51:11449:x1877942254771456:12345-192.168.202.48@tcp:35:bash.0 00000100:00100000:3.0:1790945574.907462:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+52:11449:x1877942254771456:12345-192.168.202.48@tcp:35:bash.0 Request processed in 321us (629us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1790945574.907471:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 45 00000100:00100000:1.0:1790945574.973371:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945574.973523:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254771712 00000100:00100000:0.0:1790945574.973535:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254771712 00000100:00100000:0.0:1790945574.973593:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 162 00000100:00100000:0.0:1790945574.973601:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+52:11459:x1877942254771712:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945574.973630:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945574.973653:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c83a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945574.973869:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790945574.974035:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83a6 expref: 54 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.974049:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb85a4d2d00) 00010000:00010000:0.0:1790945574.974051:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945574.974056:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83a6 expref: 54 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945574.974068:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d400, rc 0) 00000100:00100000:0.0:1790945574.974138:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+53:11459:x1877942254771712:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 537us (782us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1790945574.974146:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 162 00000100:00100000:2.0:1790945574.975837:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945574.976521:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254771840 00000100:00100000:1.0:1790945574.976533:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254771840 00000100:00100000:1.0:1790945574.976586:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 163 00000100:00100000:1.0:1790945574.976593:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+53:11459:x1877942254771840:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:1.0:1790945574.976739:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.976756:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.976767:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.976780:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.976785:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.976805:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.976907:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.976916:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.976924:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790945574.976976:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.976990:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.976998:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977007:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977014:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945574.977020:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977029:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977040:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:1.0:1790945574.977046:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945574.977051:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977056:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977066:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977070:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977074:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977077:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945574.977078:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977082:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977085:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb843765b00) 00010000:00010000:1.0:1790945574.977087:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945574.977088:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977091:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977107:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977114:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977118:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977121:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945574.977122:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977125:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977129:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:1.0:1790945574.977131:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945574.977132:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945574.977135:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945574.977207:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+53:11459:x1877942254771840:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 612us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945574.977214:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 163 00000100:00100000:3.0:1790945574.982966:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945574.983483:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254772096 00000100:00100000:0.0:1790945574.983512:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254772096 00000100:00100000:0.0:1790945574.983572:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 46 00000100:00100000:0.0:1790945574.983584:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+53:11459:x1877942254772096:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1790945574.983942:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+54:11459:x1877942254772096:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 359us (989us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1790945574.983951:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 46 00000100:00100000:2.0:1790945575.014777:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.017576:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254772352 00000100:00100000:0.0:1790945575.017592:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254772352 00000100:00100000:0.0:1790945575.017714:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 164 00000100:00100000:0.0:1790945575.017728:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+54:11462:x1877942254772352:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945575.017755:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945575.017777:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c83ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790945575.017946:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790945575.018103:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fd32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.018117:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fd32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.018128:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fd32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.018142:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.018149:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.018156:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.018282:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fd40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.018291:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.018298:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945575.018308:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790945575.018425:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fd32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.018434:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fd32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.018440:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fd32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.018445:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945575.018449:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fd32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.018456:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fd32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.018467:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:0.0:1790945575.018471:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945575.019839:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fd32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.019868:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fd32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.019890:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.019897:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.019904:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.019910:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945575.019913:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.019921:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.019932:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb8510c8700) 00010000:00010000:0.0:1790945575.019935:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945575.019937:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.019943:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.019999:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83ad expref: 57 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.020013:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fd40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83ad expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.020026:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:0.0:1790945575.020028:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945575.020031:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d200, rc 0) 00000100:00100000:0.0:1790945575.020233:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:11462:x1877942254772352:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2508us (5464us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1790945575.020243:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 164 00000100:00100000:2.0:1790945575.038611:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945575.038710:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945575.039140:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254772608 00000100:00100000:3.0:1790945575.039176:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254772608 00000100:00100000:3.0:1790945575.039265:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:3.0:1790945575.039279:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:2371:x1877942254772608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945575.039299:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945575.039333:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fd40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83ad expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.039358:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:3.0:1790945575.039364:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945575.039443:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:2371:x1877942254772608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 167us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945575.039452:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:1.0:1790945575.040720:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254772480 00000100:00100000:1.0:1790945575.040733:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254772480 00000100:00100000:1.0:1790945575.040799:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 165 00000100:00100000:1.0:1790945575.040810:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:11462:x1877942254772480:12345-192.168.202.48@tcp:54:lfs.0 00010000:00010000:1.0:1790945575.040903:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.041100:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.041113:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.041148:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.041155:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.041163:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.041170:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945575.041175:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.041183:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.041195:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:1.0:1790945575.041199:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790945575.041204:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.041210:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945575.041641:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:11462:x1877942254772480:12345-192.168.202.48@tcp:54:lfs.0 Request processed in 830us (3042us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945575.041697:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 165 00000100:00100000:2.0:1790945575.048810:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945575.049009:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254772864 00000100:00100000:3.0:1790945575.049023:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254772864 00000100:00100000:3.0:1790945575.049096:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 47 00000100:00100000:3.0:1790945575.049108:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:11462:x1877942254772864:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1790945575.049416:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:11462:x1877942254772864:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 310us (620us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1790945575.049424:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 47 00000100:00100000:0.0:1790945575.172828:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945575.172901:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254773120 00000100:00100000:1.0:1790945575.172929:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254773120 00000100:00100000:1.0:1790945575.173013:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 166 00000100:00100000:1.0:1790945575.173026:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:11480:x1877942254773120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1790945575.173067:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945575.173089:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c83b4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.173200:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.173214:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.173223:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945575.173233:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790945575.174118:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83b4 expref: 59 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.174137:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83b4 expref: 58 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.174144:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:1.0:1790945575.174147:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790945575.174150:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132400, rc 0) 00000100:00100000:1.0:1790945575.174233:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:11480:x1877942254773120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1210us (1416us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1790945575.174241:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 166 00000100:00100000:2.0:1790945575.187840:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.187903:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254773248 00000100:00100000:0.0:1790945575.187917:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254773248 00000100:00100000:0.0:1790945575.188050:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 167 00000100:00100000:0.0:1790945575.188070:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:11481:x1877942254773248:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945575.188105:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945575.188128:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fd6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c83bb expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.188204:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.188217:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.188227:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945575.188261:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790945575.188264:0:7211:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945575.188289:0:7211:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.188320:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fd6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83bb expref: 60 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.188336:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83bb expref: 59 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.188342:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:0.0:1790945575.188345:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945575.188348:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c000, rc 0) 00000100:00100000:0.0:1790945575.188427:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+59:11481:x1877942254773248:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 360us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945575.188435:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 167 00000100:00100000:2.0:1790945575.191810:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945575.191881:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254773632 00000100:00100000:3.0:1790945575.191895:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254773632 00000100:00100000:3.0:1790945575.191965:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 48 00000100:00100000:3.0:1790945575.191977:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+59:11481:x1877942254773632:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1790945575.192427:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:11481:x1877942254773632:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 451us (630us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1790945575.192436:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 48 00000100:00100000:2.0:1790945575.195765:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945575.196151:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254773760 00000100:00100000:1.0:1790945575.196166:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254773760 00000100:00100000:1.0:1790945575.196244:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:1.0:1790945575.196256:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881605c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:11481:x1877942254773760:12345-192.168.202.48@tcp:103:lfs.0 00010000:00010000:1.0:1790945575.196278:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790945575.196309:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a54fd01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c839f expref: 60 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.196336:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83b4 expref: 59 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.196350:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54fc0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8360 expref: 58 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.197200:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8800) 00010000:00010000:1.0:1790945575.197222:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945575.197311:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881605c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:11481:x1877942254773760:12345-192.168.202.48@tcp:103:lfs.0 Request processed in 1055us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945575.197323:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:2.0:1790945575.206833:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.206902:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254773888 00000100:00100000:0.0:1790945575.206915:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254773888 00000100:00100000:1.0:1790945575.207192:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 168 00000100:00100000:1.0:1790945575.207207:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:11481:x1877942254773888:12345-192.168.202.48@tcp:58:lfs.0 00010000:00010000:1.0:1790945575.207397:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd78 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.207428:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.207444:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790945575.207782:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1790945575.207900:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:11481:x1877942254773888:12345-192.168.202.48@tcp:58:lfs.0 Request processed in 696us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945575.207910:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 168 00000100:00100000:2.0:1790945575.232836:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945575.233004:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254774016 00000100:00100000:1.0:1790945575.233018:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254774016 00000100:00100000:1.0:1790945575.233094:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 169 00000100:00100000:1.0:1790945575.233107:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:11483:x1877942254774016:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1790945575.233137:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945575.233164:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c83c2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233243:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233258:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233267:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233278:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fd8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233304:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fd8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233312:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fd8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233487:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fd94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233494:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fd94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233499:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fd94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945575.233537:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790945575.233541:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790945575.233558:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fd94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233567:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fd94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233574:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233582:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233589:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233616:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945575.233622:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233630:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233642:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:1.0:1790945575.233645:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945575.233649:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.233654:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fd86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.234789:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fd8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.234798:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fd8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.234805:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fd8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.234811:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133a00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945575.234816:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fd8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.234823:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fd8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.234853:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb843765d00) 00010000:00010000:1.0:1790945575.234920:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945575.234925:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fd8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.234931:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fd8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.234994:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132800/0xc5cf2c2a6a54fd7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83c2 expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.235010:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fd94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83c2 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.235017:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:1.0:1790945575.235019:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790945575.235022:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133600, rc 0) 00000100:00100000:1.0:1790945575.235125:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:11483:x1877942254774016:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2019us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945575.235135:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 169 00000040:00080000:2.0:1790945575.323939:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945575.323954:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945575.324036:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1790945575.324049:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790945575.324227:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881605500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1877942273646464:192.168.202.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790945575.324394:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8518096c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945575.331957:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881605500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1877942273646464:192.168.202.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790945575.332880:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.333282:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254774144 00000100:00100000:0.0:1790945575.333294:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254774144 00000100:00100000:0.0:1790945575.333371:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 170 00000100:00100000:0.0:1790945575.333383:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:11494:x1877942254774144:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790945575.333441:0:5825:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790945575.333621:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:11494:x1877942254774144:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 Request processed in 236us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945575.333632:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 170 00000100:00100000:2.0:1790945575.339835:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.341492:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254774272 00000100:00100000:0.0:1790945575.341511:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254774272 00000100:00100000:0.0:1790945575.341604:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 171 00000100:00100000:0.0:1790945575.341616:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:11494:x1877942254774272:12345-192.168.202.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790945575.341772:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd9b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.341794:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.341808:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342085:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fda2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342109:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fda2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342122:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fda2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342156:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fda9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342164:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342171:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945575.342212:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790945575.342216:0:7211:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945575.342229:0:7211:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342240:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342380:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd9b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342389:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd9b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342396:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945575.342400:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd9b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342408:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd9b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342429:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a900) 00010000:00010000:0.0:1790945575.342432:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945575.342437:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd9b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342443:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54fd9b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342457:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fda2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342464:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fda2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342470:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fda2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342475:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945575.342483:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fda2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342490:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fda2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342497:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9bb8510c8700) 00010000:00010000:0.0:1790945575.342499:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945575.342501:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fda2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342506:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fda2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342523:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342529:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fda9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342534:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fda9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342538:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1ca00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945575.342541:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fda9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342547:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fda9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342554:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:0.0:1790945575.342556:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945575.342565:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fda9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.342571:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fda9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945575.342789:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:11494:x1877942254774272:12345-192.168.202.48@tcp:34:lhsmtool_posix.0 Request processed in 1170us (2964us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945575.342809:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 171 00000100:00100000:3.0:1790945575.349328:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.349531:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254774528 00000100:00100000:0.0:1790945575.349542:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254774528 00000100:00100000:0.0:1790945575.349601:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 172 00000100:00100000:0.0:1790945575.349611:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:11494:x1877942254774528:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945575.349632:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945575.349652:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fdb0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c83c9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.349816:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.349832:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.349844:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945575.349854:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790945575.350222:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.350232:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.350257:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.350264:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945575.350280:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.350289:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.350302:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:0.0:1790945575.350305:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945575.350310:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.350316:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.350365:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fdb0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83c9 expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.350376:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a900) 00010000:00010000:0.0:1790945575.350379:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945575.350383:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fdb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83c9 expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.350394:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1da00, rc 0) 00000100:00100000:0.0:1790945575.350504:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+59:11494:x1877942254774528:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 894us (1186us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1790945575.350522:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 172 00000100:00100000:2.0:1790945575.367540:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.375475:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254774656 00000100:00100000:0.0:1790945575.375491:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254774656 00000100:00100000:0.0:1790945575.375560:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 173 00000100:00100000:0.0:1790945575.375571:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+59:11494:x1877942254774656:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790945575.375602:0:5823:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790945575.375918:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+59:11494:x1877942254774656:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 Request processed in 348us (8388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945575.375927:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 173 00000100:00100000:2.0:1790945575.381867:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945575.382000:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254774912 00000100:00100000:1.0:1790945575.382011:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254774912 00000100:00100000:1.0:1790945575.382064:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 174 00000100:00100000:1.0:1790945575.382073:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+59:11494:x1877942254774912:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945575.382094:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945575.382097:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790945575.382120:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fd71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83bb expref: 59 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.382142:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:1.0:1790945575.382146:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790945575.382160:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fdc5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c83d0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790945575.382754:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1790945575.383548:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fdcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.383565:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fdcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.383575:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fdcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.383633:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fdc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83d0 expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.383651:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fdcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83d0 expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.383728:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb843765d00) 00010000:00010000:1.0:1790945575.383731:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945575.383734:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132200, rc 0) 00000100:00100000:1.0:1790945575.383791:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:11494:x1877942254774912:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 1720us (1932us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1790945575.384480:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 174 00000100:00100000:2.0:1790945575.386706:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945575.386881:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254775168 00000100:00100000:3.0:1790945575.386891:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254775168 00000100:00100000:3.0:1790945575.386947:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 175 00000100:00100000:3.0:1790945575.386955:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:11494:x1877942254775168:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790945575.387018:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945575.387041:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fdcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83d0 expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387059:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb843765d00) 00010000:00010000:3.0:1790945575.387073:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945575.387093:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fdda lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387106:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fdda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387114:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fdda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387127:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fde1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa86fba6f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387134:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fde1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa86fba6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387141:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fde1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa86fba6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387208:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fdda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387216:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fdda lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387222:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fdda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387228:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945575.387232:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fdda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387239:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fdda lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387246:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:3.0:1790945575.387249:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945575.387252:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fdda lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387258:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a54fdda lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.387266:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fde1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa86fba6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.388568:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fde1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa86fba6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.388576:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fde1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa86fba6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.388596:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031c00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945575.388600:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fde1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa86fba6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.388607:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fde1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa86fba6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.388619:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa86fba6f (ffff9bb85a4d2800) 00010000:00010000:3.0:1790945575.388623:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945575.388626:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fde1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa86fba6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.388632:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fde1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa86fba6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945575.388752:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+59:11494:x1877942254775168:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 1795us (2053us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790945575.388760:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 175 00000100:00100000:1.0:1790945575.404380:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.407875:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254775296 00000100:00100000:0.0:1790945575.407888:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254775296 00000100:00100000:0.0:1790945575.407990:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 176 00000100:00100000:0.0:1790945575.408000:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+59:11494:x1877942254775296:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945575.408020:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945575.408041:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fde8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c83d7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.408074:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.408087:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.408098:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.408181:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54fde8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83d7 expref: 61 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.408202:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83d7 expref: 60 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.408210:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb8510c8700) 00010000:00010000:0.0:1790945575.408213:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790945575.408216:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1cc00, rc 0) 00000100:00100000:0.0:1790945575.409873:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:11494:x1877942254775296:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 1866us (5907us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945575.409884:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 176 00000100:00100000:2.0:1790945575.414601:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.415014:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254775552 00000100:00100000:0.0:1790945575.415024:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254775552 00000100:00100000:0.0:1790945575.415072:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 177 00000100:00100000:0.0:1790945575.415081:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:11494:x1877942254775552:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790945575.415154:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fdf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.415170:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fdf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.415181:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fdf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790945575.415609:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1790945575.415618:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321210960319ns, next at 322210958135ns, rc = 0 00000004:00010000:0.0:1790945575.415731:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e0a9f595 reply state 00000000dff60381 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fdf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945575.415757:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945575.416227:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:11494:x1877942254775552:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 1144us (1631us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1790945575.416236:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 177 00000100:00100000:3.0:1790945575.424507:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1790945575.424789:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fdf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.424812:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fdf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.424820:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fdf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.424827:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945575.424831:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fdf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.424839:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fdf6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.424859:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb8510c8700) 00010000:00010000:1.0:1790945575.424862:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790945575.424867:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fdf6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.424874:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fdf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945575.425116:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254775680 00000100:00100000:3.0:1790945575.425126:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254775680 00000100:00100000:3.0:1790945575.425185:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 178 00000100:00100000:3.0:1790945575.425194:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:11494:x1877942254775680:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945575.425217:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945575.425232:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fdfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c83de expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.425295:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fdfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83de expref: 62 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.425319:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fdfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83de expref: 62 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.425339:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb8510c8700) 00010000:00010000:3.0:1790945575.425342:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945575.425344:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840031c00, rc 0) 00000100:00100000:3.0:1790945575.425400:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:11494:x1877942254775680:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 207us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945575.425407:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 178 00000100:00100000:2.0:1790945575.433239:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945575.433482:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254775808 00000100:00100000:1.0:1790945575.433492:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254775808 00000100:00100000:1.0:1790945575.433561:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 50 00000100:00100000:1.0:1790945575.433570:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254775808:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790945575.433872:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945575.434070:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2373:x1877942254775808:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 Request processed in 499us (838us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1790945575.434089:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 50 00000100:00100000:3.0:1790945575.436106:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945575.436317:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254776064 00000100:00100000:1.0:1790945575.436326:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254776064 00000100:00100000:1.0:1790945575.436381:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 49 00000100:00100000:1.0:1790945575.436390:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:11494:x1877942254776064:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790945575.436591:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+63:11494:x1877942254776064:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 201us (490us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1790945575.436599:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 49 00000100:00100000:2.0:1790945575.439740:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.439828:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254776320 00000100:00100000:0.0:1790945575.439839:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254776320 00000100:00100000:0.0:1790945575.439892:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 179 00000100:00100000:0.0:1790945575.439901:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+63:11494:x1877942254776320:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790945575.440204:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+63:11494:x1877942254776320:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 302us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945575.440212:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 179 00000100:00100000:3.0:1790945575.450207:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945575.450989:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254776448 00000100:00100000:2.0:1790945575.450999:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254776448 00000100:00100000:2.0:1790945575.451059:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 180 00000100:00100000:2.0:1790945575.451068:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+63:11494:x1877942254776448:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945575.451086:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945575.451104:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fe04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c83e5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.451166:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fe0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.451179:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fe0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.451190:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fe0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945575.451235:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945575.451251:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fe0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.451481:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fe04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83e5 expref: 65 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.451498:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fe0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83e5 expref: 64 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.451507:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb8510c8700) 00010000:00010000:2.0:1790945575.451511:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790945575.451514:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434aee00, rc 0) 00000100:00100000:2.0:1790945575.451567:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+64:11494:x1877942254776448:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 500us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945575.451574:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 180 00000100:00100000:2.0:1790945575.458147:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945575.461822:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254776576 00000100:00100000:3.0:1790945575.461836:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254776576 00000100:00100000:3.0:1790945575.461897:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 51 00000100:00100000:3.0:1790945575.461907:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2373:x1877942254776576:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945575.461923:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945575.461942:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a54fe12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c83ec expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945575.461969:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfa927, blocks: 0x1 00010000:00010000:3.0:1790945575.461986:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1790945575.461990:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945575.461999:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a54fe12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83ec expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.462036:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a54fe12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83ec expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.462049:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030000, rc 0) 00000100:00100000:3.0:1790945575.462114:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2373:x1877942254776576:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 208us (3975us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945575.462122:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 51 00000100:00100000:2.0:1790945575.476520:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.479102:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254776832 00000100:00100000:0.0:1790945575.479117:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254776832 00000100:00100000:0.0:1790945575.479186:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 181 00000100:00100000:0.0:1790945575.479197:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+64:11494:x1877942254776832:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790945575.479313:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+64:11494:x1877942254776832:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 118us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945575.479322:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 181 00000100:00100000:3.0:1790945575.487203:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945575.487299:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254776960 00000100:00100000:2.0:1790945575.487310:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254776960 00000100:00100000:2.0:1790945575.487367:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 52 00000100:00100000:2.0:1790945575.487377:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:11494:x1877942254776960:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945575.487393:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945575.487412:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c558687c/0xc5cf2c2a6a54fe19 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c83f3 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.487444:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a54fe12 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83ec expref: 9 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.487467:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945575.487471:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945575.487476:0:6670:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c558687c/0xc5cf2c2a6a54fe19 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83f3 expref: 9 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.487508:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a54fe12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83ec expref: 9 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.487522:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a54fe12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83ec expref: 9 pid: 6673 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945575.487536:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881607b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1877942273646592:192.168.202.48@tcp:104: 00000100:00100000:2.0:1790945575.487633:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb851809000 going to sleep for 11 seconds 00000100:00100000:2.0:1790945575.492282:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881607b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1877942273646592:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945575.492319:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c558687c/0xc5cf2c2a6a54fe19 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83f3 expref: 9 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.492340:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434af400, rc 0) 00000100:00100000:2.0:1790945575.492400:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:11494:x1877942254776960:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 5023us (5205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945575.492409:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 52 00000100:00100000:3.0:1790945575.499450:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945575.499567:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254777088 00000100:00100000:1.0:1790945575.499580:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254777088 00010000:00010000:1.0:1790945575.499625:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a54fe12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83ec expref: 9 pid: 6673 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945575.499714:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:1.0:1790945575.499725:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2373:x1877942254777088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945575.499740:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945575.499760:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a54fe12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83ec expref: 9 pid: 6673 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.499774:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a54fe12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83ec expref: 9 pid: 6673 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.499796:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a54fe12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83ec expref: 9 pid: 6673 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.499830:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945575.499834:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945575.499842:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c558687c/0xc5cf2c2a6a54fe19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83f3 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.499852:0:8440:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c558687c/0xc5cf2c2a6a54fe19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83f3 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.499887:0:8440:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c558687c/0xc5cf2c2a6a54fe19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83f3 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945575.499900:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8814aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8440:1877942273646720:192.168.202.48@tcp:105: 00000100:00100000:3.0:1790945575.503839:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790945575.510077:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945575.510178:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254777216 00000100:00100000:1.0:1790945575.510187:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254777216 00002000:00100000:1.0:1790945575.510235:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9bb87fe5f480 x1877942254777216/t0(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:271/0 lens 504/0 e 0 to 0 dl 1790945586 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945575.510246:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb87fe5f480 with x1877942254777216 ext(0->8) 00002000:00010000:1.0:1790945575.510251:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb87fe5f480 00000100:00100000:1.0:1790945575.510286:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:1.0:1790945575.510295:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2372:x1877942254777216:12345-192.168.202.48@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790945575.510762:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:2372:x1877942254777216:12345-192.168.202.48@tcp:4:lhsmtool_posix.0 Request processed in 467us (693us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790945575.510770:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:0.0:1790945575.510772:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8814aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8440:1877942273646720:192.168.202.48@tcp:105: 00002000:00100000:1.0:1790945575.510783:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9bb87fe5f480 x1877942254777216/t4294967314(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:271/0 lens 504/448 e 0 to 0 dl 1790945586 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945575.510792:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb87fe5f480 with x1877942254777216 ext(0->8) 00002000:00010000:1.0:1790945575.510795:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb87fe5f480 00010000:00010000:0.0:1790945575.510799:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945575.510822:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:2373:x1877942254777088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 11100us (11388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945575.510830:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:2.0:1790945575.512611:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.512713:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254777344 00000100:00100000:0.0:1790945575.512734:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254777344 00000100:00100000:0.0:1790945575.512783:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 182 00000100:00100000:0.0:1790945575.512792:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+64:11494:x1877942254777344:12345-192.168.202.48@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1790945575.619790:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+64:11494:x1877942254777344:12345-192.168.202.48@tcp:44:lhsmtool_posix.0 Request processed in 106986us (107174us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945575.619804:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 182 00000001:00080000:3.0:1790945575.620163:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1790945575.620170:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:3.0:1790945575.620221:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:3.0:1790945575.620267:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:1.0:1790945575.620552:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945575.620567:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8814aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273646848:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1790945575.620607:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb8738953c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1790945575.620610:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb8456e5e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb873895b40 00000020:00080000:3.0:1790945575.620614:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb8456e5600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb8738fe400 00000100:00100000:1.0:1790945575.620614:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945575.620760:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273646848 00000100:00100000:3.0:1790945575.620766:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273646848 00000100:00100000:3.0:1790945575.620812:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790945575.620812:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273646976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790945575.620820:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273646848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790945575.620864:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1790945575.620964:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790945575.620968:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790945575 00002000:00010000:3.0:1790945575.620976:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790945575.620978:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790945575 -> 1790945575 00002000:00010000:3.0:1790945575.620981:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790945575.621030:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273646848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (415us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1790945575.621038:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790945575.621052:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273646976 00000100:00100000:3.0:1790945575.621055:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273646976 00000100:00100000:3.0:1790945575.621080:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790945575.621086:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273646976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790945575.621099:0:6673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00000100:00100000:2.0:1790945575.621117:0:3293:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00002000:00010000:3.0:1790945575.621122:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abfa925, atime: 0x6abfa925, ctime: 0x6abfa925, blocks: 0x1 00000004:00080000:2.0:1790945575.621122:0:3293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb87fe5c000, transno 4294967312 00010000:00010000:3.0:1790945575.621129:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945575.621138:0:3293:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9bb8814aea00 x1877942273646848/t4294967315(4294967315) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790945591 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1790945575.621143:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1790945575.621147:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00000004:00080000:2.0:1790945575.621148:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb8814aea00/2, rc 0, transno 4294967315 00010000:00010000:3.0:1790945575.621153:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945575.621153:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8814aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273646848:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1790945575.621169:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.621179:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790945575.623883:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790945575.623893:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1790945575.623909:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:3.0:1790945575.624003:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.624037:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1790945575.624323:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1790945575.624930:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3293:x1877942273646976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3841us (4074us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790945575.624940:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:3.0:1790945575.624975:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:2.0:1790945575.624979:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb87fe5c380/2, rc 0, transno 4294967307 00010000:00010000:3.0:1790945575.624982:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945575.624985:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273646976:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1790945575.624991:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030e00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945575.624995:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.625006:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.625026:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.625033:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.625054:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945575.625056:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945575.625057:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945575.629342:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.629426:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254777472 00000100:00100000:0.0:1790945575.629438:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254777472 00000100:00100000:0.0:1790945575.629494:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 55 00000100:00100000:0.0:1790945575.629503:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:2372:x1877942254777472:12345-192.168.202.48@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1790945575.649789:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945575.690922:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:2372:x1877942254777472:12345-192.168.202.48@tcp:16:lhsmtool_posix.0 Request processed in 61408us (61578us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945575.690936:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 55 00000001:00080000:2.0:1790945575.692590:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1790945575.692611:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1790945575.695614:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945575.695785:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254777728 00000100:00100000:3.0:1790945575.695795:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254777728 00000100:00100000:3.0:1790945575.695870:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 183 00000100:00100000:3.0:1790945575.695880:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb874acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:11494:x1877942254777728:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790945575.695930:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945575.695957:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aee00/0xc5cf2c2a6a54fe0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83e5 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.696091:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb8510c8700) 00010000:00010000:3.0:1790945575.696098:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945575.696127:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.696141:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.696151:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790945575.696451:0:7211:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000118782bc reply state 00000000762c4d19 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945575.696461:0:7211:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945575.696560:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb874acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:11494:x1877942254777728:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 680us (954us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1790945575.696568:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 183 00010000:00010000:3.0:1790945575.698971:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.698993:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.699000:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.699018:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945575.699023:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.699031:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.699047:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb8510c8700) 00010000:00010000:3.0:1790945575.699050:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945575.699055:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.699061:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945575.701884:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945575.710824:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273647104:0@lo:400:kworker.0 00000100:00100000:1.0:1790945575.710897:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945575.710947:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945575.710953:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273647232:0@lo:400:kworker.0 00000100:00100000:1.0:1790945575.710991:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945575.711025:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273647104 00000100:00100000:1.0:1790945575.711033:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273647104 00000100:00100000:1.0:1790945575.711079:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1790945575.711087:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273647104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945575.711136:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273647104:12345-0@lo:400:kworker.0 Request processed in 49us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945575.711143:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1790945575.711198:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273647104:0@lo:400:kworker.0 00000100:00100000:3.0:1790945575.711529:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254777856 00000100:00100000:3.0:1790945575.711535:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254777856 00000100:00100000:3.0:1790945575.711722:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273647488:0@lo:400:kworker.0 00000100:00100000:3.0:1790945575.711754:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945575.711780:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790945575.711786:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273647360:0@lo:400:kworker.0 00000100:00100000:3.0:1790945575.711808:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945575.711834:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273647232 00000100:00100000:3.0:1790945575.711837:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273647232 00000100:00100000:3.0:1790945575.711864:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273647488 00000100:00100000:3.0:1790945575.711866:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273647488 00000100:00100000:3.0:1790945575.711886:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273647360 00000100:00100000:3.0:1790945575.711888:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273647360 00000100:00100000:3.0:1790945575.711901:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790945575.711907:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273647232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945575.711953:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273647232:12345-0@lo:400:kworker.0 Request processed in 46us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945575.711960:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790945575.712473:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 56 00000100:00100000:0.0:1790945575.712481:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2373:x1877942254777856:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790945575.712749:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790945575.712754:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790945575 -> 1790945575 00002000:00010000:0.0:1790945575.712756:0:6672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790945573 00002000:00010000:0.0:1790945575.712758:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790945575 -> 1790945575 00002000:00010000:0.0:1790945575.712761:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790945575.712810:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2373:x1877942254777856:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 Request processed in 329us (10934us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1790945575.712817:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 56 00000100:00100000:3.0:1790945575.713129:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790945575.713138:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273647488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945575.713194:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273647488:12345-0@lo:400:kworker.0 Request processed in 57us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945575.713200:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790945575.713214:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790945575.713221:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273647360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945575.713249:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273647360:12345-0@lo:400:kworker.0 Request processed in 29us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945575.713255:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1790945575.714124:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945575.714449:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273647360:0@lo:400:kworker.0 00000100:00100000:0.0:1790945575.714466:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273647488:0@lo:400:kworker.0 00000100:00100000:1.0:1790945575.718785:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273647232:0@lo:400:kworker.0 00000100:00100000:0.0:1790945575.732436:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945575.732493:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254778112 00000100:00100000:1.0:1790945575.732504:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254778112 00000100:00100000:1.0:1790945575.732613:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 184 00000100:00100000:1.0:1790945575.732624:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:11494:x1877942254778112:12345-192.168.202.48@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790945575.732734:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.732751:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83d7 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.732760:0:7211:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.732796:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83d7 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.732811:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83d7 expref: 19 pid: 5825 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945575.732824:0:7211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881476d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273647616:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945575.732908:0:7211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945575.736967:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945575.737054:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254778240 00000100:00100000:2.0:1790945575.737064:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254778240 00010000:00010000:2.0:1790945575.737103:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83d7 expref: 20 pid: 5825 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945575.737148:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 67 00000100:00100000:2.0:1790945575.737157:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:2373:x1877942254778240:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945575.737171:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945575.737177:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83d7 expref: 20 pid: 5825 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.737188:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83d7 expref: 20 pid: 5825 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.737208:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb8510c8700) 00010000:00010000:2.0:1790945575.737225:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.737246:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.737254:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.737283:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945575.737332:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:2373:x1877942254778240:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 176us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945575.737339:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 67 00010000:00010000:3.0:1790945575.738449:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54fdef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83d7 expref: 19 pid: 5825 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945575.738464:0:7211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881476d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1877942273647616:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945575.738486:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.740742:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.740759:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.740792:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.740800:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.740808:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.740814:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945575.740818:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.740842:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.740859:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb8510c8700) 00010000:00010000:2.0:1790945575.740862:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790945575.740867:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945575.740873:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945575.741121:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+18:11494:x1877942254778112:12345-192.168.202.48@tcp:55:lhsmtool_posix.0 Request processed in 8493us (8686us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790945575.741131:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 184 00000100:00100000:2.0:1790945575.749723:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945575.749810:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254778368 00000100:00100000:3.0:1790945575.749820:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254778368 00000100:00100000:3.0:1790945575.749907:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 57 00000100:00100000:3.0:1790945575.749917:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2372:x1877942254778368:12345-192.168.202.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790945575.749960:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.749995:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c558687c/0xc5cf2c2a6a54fe19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83f3 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.750005:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945575.750010:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945575.750015:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.750050:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c558687c/0xc5cf2c2a6a54fe19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83f3 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.750065:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c558687c/0xc5cf2c2a6a54fe19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83f3 expref: 8 pid: 6670 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945575.750081:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8715fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6673:1877942273647744:192.168.202.48@tcp:104: 00000100:00100000:3.0:1790945575.750156:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8738959c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945575.761455:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945575.761502:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8715fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6673:1877942273647744:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945575.761528:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945575.767730:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254778496 00000100:00100000:3.0:1790945575.767744:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254778496 00010000:00010000:3.0:1790945575.767784:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c558687c/0xc5cf2c2a6a54fe19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83f3 expref: 9 pid: 6670 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945575.767839:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:3.0:1790945575.767848:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2372:x1877942254778496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945575.767936:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945575.767960:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c558687c/0xc5cf2c2a6a54fe19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83f3 expref: 9 pid: 6670 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.768430:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c558687c/0xc5cf2c2a6a54fe19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83f3 expref: 9 pid: 6670 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.768455:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c558687c/0xc5cf2c2a6a54fe19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83f3 expref: 9 pid: 6670 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.768470:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945575.768474:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945575.768480:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.768491:0:5810:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.768518:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945575.768580:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2372:x1877942254778496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 732us (7133us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945575.768588:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 68 00010000:00010000:3.0:1790945575.768713:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.768724:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.768751:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.768761:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.768771:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.768778:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030e00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945575.768782:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.768791:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.768803:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.768811:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54fe35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945575.769188:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2372:x1877942254778368:12345-192.168.202.48@tcp:1:lhsmtool_posix.0 Request processed in 19271us (19536us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945575.769197:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 57 00000100:00100000:0.0:1790945575.782385:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945575.782819:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254778752 00000100:00100000:3.0:1790945575.782830:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254778752 00000100:00100000:3.0:1790945575.782875:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 185 00000100:00100000:3.0:1790945575.782885:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+18:11494:x1877942254778752:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790945575.782956:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.782973:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.782985:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.783182:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.783194:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fdfd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83de expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.783202:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.783235:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fdfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83de expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.783258:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fdfd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83de expref: 19 pid: 5824 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945575.783287:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877942273647872:192.168.202.48@tcp:104: 00000100:00100000:3.0:1790945575.783374:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8738959c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945575.787177:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945575.787372:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254778880 00000100:00100000:0.0:1790945575.787382:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254778880 00010000:00010000:0.0:1790945575.787420:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fdfd lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83de expref: 20 pid: 5824 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945575.787461:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:0.0:1790945575.787471:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:2372:x1877942254778880:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945575.787486:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945575.787491:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fdfd lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83de expref: 20 pid: 5824 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.787503:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fdfd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83de expref: 20 pid: 5824 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.787523:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb8510c8700) 00010000:00010000:0.0:1790945575.787527:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.787536:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.787542:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.787558:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945575.787605:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:2372:x1877942254778880:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 136us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945575.787625:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 69 00010000:00010000:3.0:1790945575.789558:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a54fdfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83de expref: 19 pid: 5824 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945575.789583:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877942273647872:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945575.789606:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.789616:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.789622:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945575.789844:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1790945575.789964:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1790945575.790007:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1790945575.790102:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5824:1877942273648000:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790945575.790160:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945575.790199:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb845e00f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945575.790710:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273648000 00000100:00100000:0.0:1790945575.790718:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273648000 00000100:00100000:0.0:1790945575.790770:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790945575.790779:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1877942273648000:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790945575.790872:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1877942273648000:12345-0@lo:1000:mdt00_001.0 Request processed in 94us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945575.790879:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790945575.791577:0:5824:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1790945575.791584:0:5824:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb8814aea00, transno 4294967315 00000100:00100000:3.0:1790945575.791601:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5824:1877942273648000:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1790945575.792099:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1790945575.792165:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86cad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5824:1877942273648128:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790945575.792205:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945575.792235:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881b6ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945575.792315:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273648128 00000100:00100000:0.0:1790945575.792321:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273648128 00000100:00100000:0.0:1790945575.792360:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790945575.792367:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8715fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1877942273648128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790945575.792535:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8715fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1877942273648128:12345-0@lo:1000:mdt00_001.0 Request processed in 167us (328us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1790945575.792543:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790945575.792578:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86cad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5824:1877942273648128:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1790945575.792606:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792617:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792625:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792631:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945575.792636:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792651:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792692:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb8510c8700) 00010000:00010000:0.0:1790945575.792695:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790945575.792700:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792706:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a54fe43 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792742:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792749:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd78 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792755:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792760:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945575.792763:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792769:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd78 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792776:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:0.0:1790945575.792778:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790945575.792782:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd78 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792796:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54fd78 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792818:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792832:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fd94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83c2 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792840:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792864:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fd94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83c2 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.792879:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fd94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83c2 expref: 22 pid: 5823 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945575.792890:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8817ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877942273648256:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945575.792947:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b34e180 going to sleep for 11 seconds 00000100:00100000:3.0:1790945575.800502:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8817ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877942273648256:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945575.800530:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945575.800559:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945575.800611:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254779008 00000100:00100000:3.0:1790945575.800618:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254779008 00010000:00010000:3.0:1790945575.800652:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fd94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83c2 expref: 23 pid: 5823 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945575.800802:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 70 00000100:00100000:3.0:1790945575.800814:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:2373:x1877942254779008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945575.800830:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945575.800837:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fd94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83c2 expref: 23 pid: 5823 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.800848:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fd94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83c2 expref: 23 pid: 5823 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.800870:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fd94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83c2 expref: 23 pid: 5823 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.800883:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:3.0:1790945575.800888:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.800906:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.800915:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.800936:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945575.800997:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:2373:x1877942254779008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 185us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945575.801006:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 70 00010000:00010000:3.0:1790945575.801030:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801037:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801048:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801055:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801062:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801067:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945575.801071:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801078:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801093:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:3.0:1790945575.801096:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945575.801100:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801107:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe4a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801117:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801123:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801128:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801133:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945575.801136:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801142:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801149:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765b00) 00010000:00010000:3.0:1790945575.801152:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790945575.801154:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945575.801160:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a54fe3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945575.801380:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:11494:x1877942254778752:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 18495us (19004us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1790945575.801388:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 185 00000020:00080000:3.0:1790945575.801392:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790945575.802155:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790945575.802160:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790945575.802636:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:1.0:1790945575.802688:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790945575.804396:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945575.805059:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254779264 00000100:00100000:1.0:1790945575.805068:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254779264 00000100:00100000:1.0:1790945575.805115:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 50 00000100:00100000:1.0:1790945575.805124:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8477f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:11494:x1877942254779264:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790945575.805770:0:5826:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790945575.805870:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1790945575.805915:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.805930:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.805940:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.805948:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe51 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.805954:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe51 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.805961:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945575.805992:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790945575.806061:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945575.806068:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945575.806072:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8477f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:11494:x1877942254779264:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 949us (1681us total) trans 4294967469 rc 0/0 00010000:00010000:0.0:1790945575.806075:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945575.806079:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945575.806080:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 50 00000020:00080000:1.0:1790945575.806086:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790945575.806095:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.806106:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bb843765700) 00010000:00010000:0.0:1790945575.806109:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790945575.806113:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe51 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.806118:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54fe51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945575.806138:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945575.806140:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945575.806141:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790945576.033142:0:12387:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790945576.033153:0:12387:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790945576.033201:0:12387:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1790945576.033210:0:12387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790945576.143984:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.144060:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254779520 00000100:00100000:2.0:1790945576.144071:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254779520 00000100:00100000:2.0:1790945576.144133:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 186 00000100:00100000:2.0:1790945576.144143:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:11504:x1877942254779520:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945576.144167:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945576.144186:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fe58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c83fa expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.144290:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fe5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.144304:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fe5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.144322:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fe5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945576.144335:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790945576.144445:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fe58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83fa expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.144462:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fe5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83fa expref: 25 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.144470:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:2.0:1790945576.144473:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790945576.144476:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434afa00, rc 0) 00000100:00100000:2.0:1790945576.144541:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:11504:x1877942254779520:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 399us (564us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1790945576.144549:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 186 00000100:00100000:3.0:1790945576.148614:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945576.148774:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254779648 00000100:00100000:0.0:1790945576.148785:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254779648 00000100:00100000:0.0:1790945576.148842:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 187 00000100:00100000:0.0:1790945576.148852:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:11504:x1877942254779648:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:0.0:1790945576.148924:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fe6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.148942:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fe6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.148953:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fe6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.148979:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fe74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.148987:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fe74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.148994:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fe74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149211:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149220:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149227:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790945576.149334:0:5825:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149348:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fe6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149356:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fe6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149363:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fe6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149368:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945576.149373:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fe6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149386:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fe6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149398:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:0.0:1790945576.149402:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945576.149406:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fe6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149413:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a54fe6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149425:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fe74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149431:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fe74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149437:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fe74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149443:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1ca00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945576.149446:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fe74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149452:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fe74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149459:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb8510c8700) 00010000:00010000:0.0:1790945576.149461:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945576.149464:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fe74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149479:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a54fe74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149493:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149499:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149505:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149511:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945576.149515:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149520:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149527:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb8510c8000) 00010000:00010000:0.0:1790945576.149530:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945576.149533:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.149539:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a54fe7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945576.149607:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:11504:x1877942254779648:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 755us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945576.149615:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 187 00000100:00100000:0.0:1790945576.219168:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945576.219594:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254779904 00000100:00100000:1.0:1790945576.219611:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254779904 00000100:00100000:1.0:1790945576.220088:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 188 00000100:00100000:1.0:1790945576.220101:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:11507:x1877942254779904:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1790945576.220124:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945576.220145:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fe82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8401 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220215:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fe89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220230:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fe89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220242:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fe89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220255:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fe90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220261:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fe90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220267:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fe90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220513:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54fe97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220523:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54fe97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220530:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54fe97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945576.220544:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1790945576.220632:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fe89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220639:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fe89 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220646:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fe89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220652:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945576.220688:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fe89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220707:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fe89 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220719:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:1.0:1790945576.220722:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945576.220726:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fe89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220731:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54fe89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220742:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fe90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220747:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fe90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220762:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fe90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220767:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945576.220770:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fe90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220776:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fe90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220784:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb843765e00) 00010000:00010000:1.0:1790945576.220786:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945576.220789:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fe90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220795:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a54fe90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220838:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54fe82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8401 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220852:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54fe97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8401 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.220859:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765300) 00010000:00010000:1.0:1790945576.220861:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945576.220863:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133c00, rc 0) 00000100:00100000:1.0:1790945576.220929:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:11507:x1877942254779904:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 831us (1772us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1790945576.231573:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 188 00000100:00100000:1.0:1790945576.231624:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273648384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945576.231737:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945576.231799:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945576.231807:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273648512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945576.231831:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945576.232014:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273648384 00000100:00100000:3.0:1790945576.232024:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273648384 00000100:00100000:3.0:1790945576.232057:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273648512 00000100:00100000:3.0:1790945576.232060:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273648512 00000100:00100000:3.0:1790945576.232073:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790945576.232081:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1877942273648384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945576.232115:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790945576.232165:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1877942273648384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945576.232172:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790945576.232184:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790945576.232189:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273648384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945576.232190:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1877942273648512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945576.232201:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1790945576.232237:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1877942273648512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945576.232243:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790945576.233033:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273648512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945576.240129:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945576.241375:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254780032 00000100:00100000:1.0:1790945576.241388:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254780032 00000100:00100000:1.0:1790945576.241445:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 189 00000100:00100000:1.0:1790945576.241455:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:11507:x1877942254780032:12345-192.168.202.48@tcp:54:lfs.0 00010000:00010000:1.0:1790945576.241521:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fea5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.241538:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.241550:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.241576:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.241583:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fea5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.241604:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.241610:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945576.241614:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.241621:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fea5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.241632:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765300) 00010000:00010000:1.0:1790945576.241636:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790945576.241641:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fea5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.241647:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54fea5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945576.241786:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:11507:x1877942254780032:12345-192.168.202.48@tcp:54:lfs.0 Request processed in 332us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945576.249103:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 189 00000100:00100000:0.0:1790945576.250929:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.251117:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254780288 00000100:00100000:2.0:1790945576.251127:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254780288 00000100:00100000:2.0:1790945576.251173:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 51 00000100:00100000:2.0:1790945576.251183:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:11507:x1877942254780288:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1790945576.251409:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+28:11507:x1877942254780288:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 226us (488us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1790945576.251418:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 51 00000001:00080000:1.0:1790945576.288372:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1790945576.288394:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1790945576.288406:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:0.0:1790945576.304815:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945576.304901:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254780544 00000100:00100000:1.0:1790945576.304912:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254780544 00000100:00100000:1.0:1790945576.304980:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 190 00000100:00100000:1.0:1790945576.304990:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+28:11042:x1877942254780544:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:1.0:1790945576.305016:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945576.305051:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54feac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8408 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.305145:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.305159:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54fe97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8401 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.305169:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.305201:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54fe97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8401 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.305216:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54fe97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8401 expref: 29 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945576.305230:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881475c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273648640:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945576.305314:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842bb1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790945576.312126:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881475c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273648640:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945576.312158:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945576.312641:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.312887:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254780672 00000100:00100000:2.0:1790945576.312895:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254780672 00010000:00010000:2.0:1790945576.312934:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54fe97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8401 expref: 30 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945576.312993:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 71 00000100:00100000:2.0:1790945576.313002:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:2373:x1877942254780672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945576.313017:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945576.313024:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54fe97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8401 expref: 30 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.313035:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54fe97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8401 expref: 30 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.313057:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133c00/0xc5cf2c2a6a54fe97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8401 expref: 30 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.313074:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765300) 00010000:00010000:2.0:1790945576.313079:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.313089:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.313096:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.313128:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945576.313186:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:2373:x1877942254780672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 185us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945576.313194:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 71 00010000:00010000:3.0:1790945576.313421:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.313430:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945576.313457:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1790945576.313609:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132200/0xc5cf2c2a6a54feac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8408 expref: 30 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.313624:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8408 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.313632:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765300) 00010000:00010000:3.0:1790945576.313634:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790945576.313637:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132c00, rc 0) 00000100:00100000:3.0:1790945576.313721:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:11042:x1877942254780544:12345-192.168.202.48@tcp:101:bash.0 Request processed in 8732us (8915us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1790945576.313728:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 190 00000100:00100000:0.0:1790945576.321212:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.321456:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254780928 00000100:00100000:2.0:1790945576.321483:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254780928 00000100:00100000:2.0:1790945576.321548:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 191 00000100:00100000:2.0:1790945576.321558:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:11042:x1877942254780928:12345-192.168.202.48@tcp:36:bash.0 00010000:00010000:2.0:1790945576.321876:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fec1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.321896:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.321907:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945576.321963:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:2.0:1790945576.321989:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000884bbd0 reply state 000000007b6be485 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945576.321998:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1790945576.322047:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:2.0:1790945576.322144:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:11042:x1877942254780928:12345-192.168.202.48@tcp:36:bash.0 Request processed in 586us (941us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1790945576.322152:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 191 00000020:00080000:2.0:1790945576.322158:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1790945576.325531:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.325548:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fec1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.325572:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.325579:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434aea00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945576.325584:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.325593:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fec1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.325609:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765300) 00010000:00010000:1.0:1790945576.325612:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945576.325617:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fec1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.325623:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fec1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945576.326333:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.327163:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254781056 00000100:00100000:2.0:1790945576.327175:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254781056 00000100:00100000:2.0:1790945576.327231:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 192 00000100:00100000:2.0:1790945576.327240:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+32:11042:x1877942254781056:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:2.0:1790945576.327276:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945576.327296:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fec8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c840f expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.327374:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fec8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c840f expref: 33 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.327389:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fec8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c840f expref: 33 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.327408:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765300) 00010000:00010000:2.0:1790945576.327411:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945576.327415:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434ae400, rc 0) 00000100:00100000:2.0:1790945576.327478:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:11042:x1877942254781056:12345-192.168.202.48@tcp:101:bash.0 Request processed in 239us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945576.327485:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 192 00000100:00100000:0.0:1790945576.330257:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.330402:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254781184 00000100:00100000:2.0:1790945576.330413:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254781184 00000100:00100000:2.0:1790945576.330504:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 58 00000100:00100000:2.0:1790945576.330514:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:11042:x1877942254781184:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:2.0:1790945576.330532:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945576.330553:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0f24abd/0xc5cf2c2a6a54fecf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8416 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790945576.330580:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abfa927, atime: 0x6abfa925, ctime: 0x6abfa927, blocks: 0xb 00010000:00010000:2.0:1790945576.330600:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1790945576.330604:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945576.330613:0:6672:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0f24abd/0xc5cf2c2a6a54fecf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8416 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.330650:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e0f24abd/0xc5cf2c2a6a54fecf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8416 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.330704:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8434aee00, rc 0) 00000100:00100000:2.0:1790945576.330764:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:11042:x1877942254781184:12345-192.168.202.48@tcp:101:bash.0 Request processed in 250us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945576.330772:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 58 00000100:00100000:0.0:1790945576.336540:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945576.336632:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254781312 00000100:00100000:3.0:1790945576.336643:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254781312 00002000:00010000:3.0:1790945576.336751:0:6677:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1790945576.336756:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb8817eca80 with x1877942254781312 ext(0->18446744073709551615) 00002000:00010000:3.0:1790945576.336767:0:6677:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb8817eca80. 00000100:00100000:3.0:1790945576.336797:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:3.0:1790945576.336806:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2373:x1877942254781312:12345-192.168.202.48@tcp:10:bash.0 00002000:00010000:3.0:1790945576.337061:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1790945576.337064:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790945575 -> 1790945576 00002000:00010000:3.0:1790945576.337067:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1790945573 -> 1790945573 00002000:00010000:3.0:1790945576.337069:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790945575 -> 1790945576 00002000:00010000:3.0:1790945576.337071:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1790945576.337133:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2373:x1877942254781312:12345-192.168.202.48@tcp:10:bash.0 Request processed in 327us (602us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1790945576.337140:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5 00002000:00010000:3.0:1790945576.337144:0:6677:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1790945576.337146:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb8817eca80 with x1877942254781312 ext(0->18446744073709551615) 00002000:00010000:3.0:1790945576.337151:0:6677:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb8817eca80. 00000100:00100000:0.0:1790945576.428087:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.428195:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254781440 00000100:00100000:2.0:1790945576.428205:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254781440 00000100:00100000:2.0:1790945576.428263:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 193 00000100:00100000:2.0:1790945576.428273:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:11521:x1877942254781440:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:2.0:1790945576.428341:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fed6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428357:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fed6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428370:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fed6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428388:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fedd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428395:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fedd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428401:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fedd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428633:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fee4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428644:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428650:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945576.428736:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428747:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fed6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428754:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fed6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428761:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fed6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428766:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945576.428771:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fed6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428779:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fed6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428790:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:2.0:1790945576.428793:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945576.428798:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fed6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428812:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fed6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428825:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fedd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428832:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fedd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.428838:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fedd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.429957:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434aea00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945576.429969:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fedd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.429981:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fedd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.429993:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb845042f00) 00010000:00010000:2.0:1790945576.429996:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945576.430067:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fedd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.430075:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fedd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.430098:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.430105:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fee4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.430124:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.430129:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945576.430133:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.430139:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.430148:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765300) 00010000:00010000:2.0:1790945576.430150:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945576.430153:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fee4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.430159:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54fee4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945576.430366:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:11521:x1877942254781440:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 2090us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945576.430377:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 193 00000100:00100000:0.0:1790945576.511931:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.513278:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254781696 00000100:00100000:2.0:1790945576.513291:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254781696 00000100:00100000:2.0:1790945576.513362:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 194 00000100:00100000:2.0:1790945576.513371:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+33:11524:x1877942254781696:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945576.513392:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945576.513410:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54feeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c841d expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.513498:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fef2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.513514:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fef2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.513524:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fef2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.513538:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.513545:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.513551:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.513878:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430a00/0xc5cf2c2a6a54ff00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.513888:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430a00/0xc5cf2c2a6a54ff00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.513907:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430a00/0xc5cf2c2a6a54ff00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945576.513918:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790945576.514009:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fef2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514017:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fef2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514031:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fef2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514036:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434aea00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945576.514041:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fef2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514049:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fef2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514061:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:2.0:1790945576.514064:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945576.514069:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fef2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514074:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434aea00/0xc5cf2c2a6a54fef2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514086:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514091:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fef9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514097:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514102:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945576.514105:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514120:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514129:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb845042f00) 00010000:00010000:2.0:1790945576.514131:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945576.514134:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fef9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514139:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af600/0xc5cf2c2a6a54fef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514181:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434af400/0xc5cf2c2a6a54feeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c841d expref: 36 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514194:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430a00/0xc5cf2c2a6a54ff00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c841d expref: 35 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.514200:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765300) 00010000:00010000:2.0:1790945576.514203:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790945576.514205:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865430a00, rc 0) 00000100:00100000:2.0:1790945576.514549:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:11524:x1877942254781696:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1177us (2635us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1790945576.514558:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 194 00000100:00100000:0.0:1790945576.528609:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945576.528713:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254781824 00000100:00100000:1.0:1790945576.528725:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254781824 00000100:00100000:1.0:1790945576.528784:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 195 00000100:00100000:1.0:1790945576.528794:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:11524:x1877942254781824:12345-192.168.202.48@tcp:54:lfs.0 00010000:00010000:1.0:1790945576.528858:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.528875:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8408 expref: 35 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.528885:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.528934:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8408 expref: 35 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.528947:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8408 expref: 35 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945576.528963:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881475c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877942273648768:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945576.529057:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842bb1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945576.535550:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881475c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877942273648768:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945576.535582:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945576.537477:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.537574:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254782080 00000100:00100000:2.0:1790945576.537584:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254782080 00000100:00100000:2.0:1790945576.537646:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 52 00000100:00100000:2.0:1790945576.537699:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:5613:x1877942254782080:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790945576.538031:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+37:5613:x1877942254782080:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 376us (560us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1790945576.538040:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 52 00000100:00100000:1.0:1790945576.542178:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945576.542317:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254782208 00000100:00100000:3.0:1790945576.542328:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254782208 00010000:00010000:3.0:1790945576.542368:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8408 expref: 37 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945576.542406:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 72 00000100:00100000:3.0:1790945576.542415:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881475f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+37:2373:x1877942254782208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945576.542430:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945576.542436:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8408 expref: 37 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.542449:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8408 expref: 37 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.542470:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a54feb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8408 expref: 37 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.542488:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765300) 00010000:00010000:3.0:1790945576.542493:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.542503:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.542524:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.542558:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945576.542614:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881475f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:2373:x1877942254782208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 200us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945576.542622:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 72 00010000:00010000:0.0:1790945576.543491:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.543504:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.543536:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.543543:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.543550:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.543570:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945576.543575:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.543582:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.543594:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765300) 00010000:00010000:0.0:1790945576.543597:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945576.543602:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.543607:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a54ff0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945576.543703:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:11524:x1877942254781824:12345-192.168.202.48@tcp:54:lfs.0 Request processed in 14909us (15102us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945576.543712:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 195 00000100:00100000:1.0:1790945576.555454:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.555543:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254782464 00000100:00100000:2.0:1790945576.555553:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254782464 00000100:00100000:2.0:1790945576.555607:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 53 00000100:00100000:2.0:1790945576.555616:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+35:11524:x1877942254782464:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1790945576.555879:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:11524:x1877942254782464:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 263us (434us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1790945576.555888:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 53 00010000:00010000:1.0:1790945576.668512:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945576.678830:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945576.678960:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254782720 00000100:00100000:1.0:1790945576.678972:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254782720 00000100:00100000:1.0:1790945576.679042:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 196 00000100:00100000:1.0:1790945576.679053:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+36:11534:x1877942254782720:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1790945576.679077:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945576.679097:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54ff15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8424 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679170:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679183:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679193:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679225:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ff23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679233:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ff23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679240:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ff23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679490:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54ff2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679500:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54ff2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679508:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54ff2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945576.679517:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1790945576.679608:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679616:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679624:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679630:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132a00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945576.679634:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679652:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679713:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:1.0:1790945576.679716:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945576.679722:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679728:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679743:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ff23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679749:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ff23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679754:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ff23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679759:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945576.679762:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ff23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679768:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ff23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679774:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb843765e00) 00010000:00010000:1.0:1790945576.679776:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945576.679778:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ff23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679792:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ff23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679837:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54ff15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8424 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679850:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54ff2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8424 expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.679857:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765300) 00010000:00010000:1.0:1790945576.679860:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945576.679862:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133600, rc 0) 00000100:00100000:1.0:1790945576.679929:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+38:11534:x1877942254782720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 878us (1109us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1790945576.679938:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 196 00000100:00100000:0.0:1790945576.691294:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.691720:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254782976 00000100:00100000:2.0:1790945576.691731:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254782976 00000100:00100000:2.0:1790945576.691791:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 54 00000100:00100000:2.0:1790945576.691800:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+38:11534:x1877942254782976:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1790945576.692076:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+39:11534:x1877942254782976:12345-192.168.202.48@tcp:35:cat.0 Request processed in 276us (791us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1790945576.692085:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 54 00000100:00100000:0.0:1790945576.718155:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.718237:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254783232 00000100:00100000:2.0:1790945576.718249:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254783232 00000100:00100000:2.0:1790945576.718306:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 197 00000100:00100000:2.0:1790945576.718316:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+39:11536:x1877942254783232:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:2.0:1790945576.718381:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790945576.718407:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54ff2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8424 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.718448:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430a00/0xc5cf2c2a6a54ff00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c841d expref: 38 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.718460:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae400/0xc5cf2c2a6a54fec8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c840f expref: 37 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.718469:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb843765300) 00010000:00010000:2.0:1790945576.718482:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945576.718501:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a54ff38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.718513:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a54ff38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.718522:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a54ff38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.718535:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430800/0xc5cf2c2a6a54ff3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.718541:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430800/0xc5cf2c2a6a54ff3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.718547:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430800/0xc5cf2c2a6a54ff3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.718798:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a54ff46 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.718806:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a54ff46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.718818:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a54ff46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790945576.719333:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1790945576.719343:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322514685048ns, next at 323514682866ns, rc = 0 00010000:00010000:2.0:1790945576.719396:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a54ff4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719406:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a54ff4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719413:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a54ff4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719421:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a54ff4d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719427:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a54ff4d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719434:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a54ff4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719462:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945576.719481:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a54ff46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719488:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a54ff46 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719495:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a54ff46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719507:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865431000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945576.719512:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a54ff46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719519:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a54ff46 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719528:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb845042900) 00010000:00010000:2.0:1790945576.719531:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790945576.719535:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a54ff46 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719541:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a54ff46 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719558:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a54ff38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719565:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a54ff38 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719571:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a54ff38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719577:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865430200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945576.719580:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a54ff38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719586:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a54ff38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719603:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:2.0:1790945576.719606:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945576.719609:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a54ff38 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.719616:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a54ff38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945576.719625:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e4db1581 reply state 00000000051bc5e2 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430800/0xc5cf2c2a6a54ff3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945576.719633:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790945576.719750:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+38:11536:x1877942254783232:12345-192.168.202.48@tcp:36:rm.0 Request processed in 1433us (1604us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1790945576.719760:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 197 00010000:00010000:3.0:1790945576.720402:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945576.720409:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a54ff4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.720416:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865431800 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945576.720419:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a54ff4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.720426:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a54ff4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.720436:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bb845042900) 00010000:00010000:3.0:1790945576.720438:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790945576.720441:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a54ff4d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.720446:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a54ff4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.720463:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945576.720465:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945576.720466:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945576.729477:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430800/0xc5cf2c2a6a54ff3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.729495:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430800/0xc5cf2c2a6a54ff3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.729503:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430800/0xc5cf2c2a6a54ff3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.729510:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865430800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945576.729529:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430800/0xc5cf2c2a6a54ff3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.729538:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430800/0xc5cf2c2a6a54ff3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.729555:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb845042f00) 00010000:00010000:0.0:1790945576.729559:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945576.729564:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430800/0xc5cf2c2a6a54ff3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.729571:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430800/0xc5cf2c2a6a54ff3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945576.778838:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945576.778951:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254783488 00000100:00100000:1.0:1790945576.778970:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254783488 00000100:00100000:1.0:1790945576.779037:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 198 00000100:00100000:1.0:1790945576.779047:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+37:11542:x1877942254783488:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:1.0:1790945576.779070:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945576.779089:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ff54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c842b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.779205:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.779219:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.779242:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.779269:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ff62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.779277:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ff62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.779283:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ff62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790945576.779830:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1790945576.780364:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54ff69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.780380:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54ff69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.780389:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54ff69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.780426:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.780434:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff5b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.780442:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.780448:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132a00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945576.780461:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.780470:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.780486:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:1.0:1790945576.780490:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945576.780496:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.780503:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a54ff5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790945576.780517:0:5823:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bb854144 reply state 00000000c3dab869 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ff62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945576.780526:0:5823:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790945576.780554:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ff54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c842b expref: 40 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.780568:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54ff69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c842b expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945576.780583:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb843765c00) 00010000:00010000:1.0:1790945576.780586:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945576.780591:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133e00, rc 0) 00000100:00100000:1.0:1790945576.780757:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+40:11542:x1877942254783488:12345-192.168.202.48@tcp:101:bash.0 Request processed in 1710us (1928us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1790945576.780766:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 198 00010000:00010000:0.0:1790945576.784278:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ff62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.784296:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ff62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.784305:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ff62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.784311:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945576.784316:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ff62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.784325:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ff62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.784341:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb843765e00) 00010000:00010000:0.0:1790945576.784360:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945576.784365:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ff62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.784372:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ff62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945576.790790:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.791327:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254783616 00000100:00100000:2.0:1790945576.791338:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254783616 00000100:00100000:2.0:1790945576.791416:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 59 00000100:00100000:2.0:1790945576.791427:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2372:x1877942254783616:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:2.0:1790945576.791446:0:7919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945576.791467:0:7919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015a7f260/0xc5cf2c2a6a54ff77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8432 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790945576.791492:0:7919:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790945576.791510:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1790945576.791514:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945576.791524:0:7919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015a7f260/0xc5cf2c2a6a54ff77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8432 expref: 6 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.791563:0:7919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015a7f260/0xc5cf2c2a6a54ff77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8432 expref: 6 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.791577:0:7919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865430200, rc 0) 00000100:00080000:3.0:1790945576.791770:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945576.791825:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254783616:12345-192.168.202.48@tcp:101:bash.0 Request processed in 400us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945576.791833:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 59 00000100:00100000:0.0:1790945576.795560:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945576.795652:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254783744 00000100:00100000:3.0:1790945576.795694:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254783744 00000100:00100000:3.0:1790945576.795795:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 60 00000100:00100000:3.0:1790945576.795805:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:11542:x1877942254783744:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:3.0:1790945576.795823:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945576.795851:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8439 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.795882:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015a7f260/0xc5cf2c2a6a54ff77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8432 expref: 7 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.795899:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945576.795903:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945576.795910:0:6670:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.795941:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015a7f260/0xc5cf2c2a6a54ff77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8432 expref: 7 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.795955:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015a7f260/0xc5cf2c2a6a54ff77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8432 expref: 7 pid: 7919 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945576.795969:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1877942273648896:192.168.202.48@tcp:104: 00000100:00100000:3.0:1790945576.796052:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8738959c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945576.799229:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945576.799363:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254783872 00000100:00100000:0.0:1790945576.799372:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254783872 00010000:00010000:0.0:1790945576.799420:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015a7f260/0xc5cf2c2a6a54ff77 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8432 expref: 8 pid: 7919 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945576.799458:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 73 00000100:00100000:0.0:1790945576.799467:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881475500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2373:x1877942254783872:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945576.799481:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945576.799503:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015a7f260/0xc5cf2c2a6a54ff77 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8432 expref: 8 pid: 7919 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.799516:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015a7f260/0xc5cf2c2a6a54ff77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8432 expref: 8 pid: 7919 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.799539:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945576.799543:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945576.799551:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.799579:0:5808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.799612:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945576.799625:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873a34380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1877942273649024:192.168.202.48@tcp:105: 00000100:00100000:0.0:1790945576.799730:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b34e600 going to sleep for 11 seconds 00010000:00010000:3.0:1790945576.800521:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015a7f260/0xc5cf2c2a6a54ff77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8432 expref: 8 pid: 7919 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945576.800551:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1877942273648896:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945576.800573:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945576.800584:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840030e00, rc 0) 00000100:00100000:3.0:1790945576.800629:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:11542:x1877942254783744:12345-192.168.202.48@tcp:101:bash.0 Request processed in 4825us (5077us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945576.800637:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 60 00000100:00100000:0.0:1790945576.804738:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873a34380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1877942273649024:192.168.202.48@tcp:105: 00010000:00010000:0.0:1790945576.804763:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945576.804825:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881475500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2373:x1877942254783872:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5358us (5605us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945576.804837:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 73 00000100:00100000:0.0:1790945576.807739:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.807819:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254784128 00000100:00100000:2.0:1790945576.807829:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254784128 00000100:00100000:2.0:1790945576.807887:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 55 00000100:00100000:2.0:1790945576.808042:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+39:11542:x1877942254784128:12345-192.168.202.48@tcp:35:bash.0 00000100:00100000:2.0:1790945576.808390:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+40:11542:x1877942254784128:12345-192.168.202.48@tcp:35:bash.0 Request processed in 352us (659us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1790945576.811311:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 55 00000100:00100000:2.0:1790945576.973575:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945576.973753:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254784256 00000100:00100000:0.0:1790945576.973763:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254784256 00000100:00100000:0.0:1790945576.973820:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 199 00000100:00100000:0.0:1790945576.973829:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+40:11558:x1877942254784256:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945576.973852:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945576.973870:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54ff85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8440 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.973942:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54ff8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.973973:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54ff8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.973985:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54ff8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945576.974022:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790945576.974026:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945576.974043:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54ff8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.974067:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a54ff85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8440 expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.974084:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54ff8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8440 expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.974094:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:0.0:1790945576.974097:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945576.974100:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d400, rc 0) 00000100:00100000:0.0:1790945576.974165:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:11558:x1877942254784256:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 336us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945576.974172:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 199 00000100:00100000:0.0:1790945576.979895:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.980514:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254784512 00000100:00100000:2.0:1790945576.980524:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254784512 00000100:00100000:2.0:1790945576.980587:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 200 00000100:00100000:2.0:1790945576.980597:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+41:11558:x1877942254784512:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945576.980617:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945576.980637:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430a00/0xc5cf2c2a6a54ff93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8447 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.980797:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ff9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.980825:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ff9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.980836:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ff9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945576.980860:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790945576.980998:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430a00/0xc5cf2c2a6a54ff93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8447 expref: 44 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.981016:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ff9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8447 expref: 43 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.981024:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb843765c00) 00010000:00010000:2.0:1790945576.981026:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945576.981030:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431e00, rc 0) 00000100:00100000:2.0:1790945576.981086:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+43:11558:x1877942254784512:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 491us (1202us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1790945576.981093:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 200 00000100:00100000:3.0:1790945576.985997:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945576.986039:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945576.986127:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254784896 00000100:00100000:2.0:1790945576.986137:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254784896 00000100:00100000:2.0:1790945576.986199:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:2.0:1790945576.986208:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+43:2373:x1877942254784896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945576.986224:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945576.986249:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ff9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8447 expref: 43 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945576.986300:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb843765c00) 00010000:00010000:2.0:1790945576.986306:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945576.986366:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+42:2373:x1877942254784896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 158us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945576.986373:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:0.0:1790945576.986692:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254784768 00000100:00100000:0.0:1790945576.986697:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254784768 00000100:00100000:0.0:1790945576.986727:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 201 00000100:00100000:0.0:1790945576.986733:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+42:11558:x1877942254784768:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945576.986759:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945576.986773:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54ffa8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c844e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.986849:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54ffaf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.986861:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54ffaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.986871:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54ffaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945576.986880:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790945576.986998:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a54ffa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c844e expref: 45 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.987012:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54ffaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c844e expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.987019:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb843765c00) 00010000:00010000:0.0:1790945576.987021:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790945576.987023:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c200, rc 0) 00000100:00100000:0.0:1790945576.987051:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+44:11558:x1877942254784768:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 318us (1065us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1790945576.987057:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 201 00000100:00100000:3.0:1790945576.998708:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945576.998797:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254785024 00000100:00100000:0.0:1790945576.998807:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254785024 00000100:00100000:0.0:1790945576.998872:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:0.0:1790945576.999094:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+6:2372:x1877942254785024:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1790945576.999140:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.999160:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.999169:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945576.999173:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790945576.999178:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.999224:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945576.999240:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 6 pid: 6670 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945576.999254:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fa05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1877942273649152:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945576.999361:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b34e600 going to sleep for 11 seconds 00000100:00100000:3.0:1790945577.003376:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945577.003525:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254785152 00000100:00100000:1.0:1790945577.003535:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254785152 00002000:00100000:1.0:1790945577.003584:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9bb873d71180 x1877942254785152/t0(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:273/0 lens 504/0 e 0 to 0 dl 1790945588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945577.003594:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb873d71180 with x1877942254785152 ext(0->8) 00010000:00010000:1.0:1790945577.003604:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 7 pid: 6670 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.003620:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 7 pid: 6670 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790945577.003628:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bb873d71180 00000100:00100000:1.0:1790945577.003698:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3 00000100:00100000:1.0:1790945577.003708:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2373:x1877942254785152:12345-192.168.202.48@tcp:4:lfs.0 00000100:00100000:1.0:1790945577.004196:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2373:x1877942254785152:12345-192.168.202.48@tcp:4:lfs.0 Request processed in 487us (828us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790945577.004204:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3 00002000:00100000:1.0:1790945577.004212:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9bb873d71180 x1877942254785152/t4294967308(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:273/0 lens 504/448 e 0 to 0 dl 1790945588 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945577.004220:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb873d71180 with x1877942254785152 ext(0->8) 00010000:00010000:1.0:1790945577.004226:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 9 pid: 6670 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.004237:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 9 pid: 6670 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790945577.004252:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bb873d71180 00000100:00100000:0.0:1790945577.004577:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fa05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1877942273649152:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945577.004601:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945577.008758:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945577.008839:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254785280 00000100:00100000:0.0:1790945577.008857:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254785280 00010000:00010000:0.0:1790945577.008918:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 9 pid: 6670 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945577.008966:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 74 00000100:00100000:0.0:1790945577.008975:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2371:x1877942254785280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945577.008989:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790945577.009007:0:5809:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790945577.009010:0:5809:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790945577 00002000:00010000:0.0:1790945577.009012:0:5809:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790945577 00002000:00010000:0.0:1790945577.009014:0:5809:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790945577 00010000:00010000:0.0:1790945577.009020:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 9 pid: 6670 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.009033:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 9 pid: 6670 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.009056:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000378e3b03/0xc5cf2c2a6a54ff7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8439 expref: 9 pid: 6670 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.009074:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790945577.009078:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790945577.009084:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.009095:0:5809:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.009138:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945577.009196:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2371:x1877942254785280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 222us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945577.009203:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 74 00010000:00010000:3.0:1790945577.009525:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.009535:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.009559:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.009568:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.009588:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.009595:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945577.009599:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.009608:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.009632:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.009640:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ebc3ef4/0xc5cf2c2a6a54ffbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945577.009718:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2372:x1877942254785024:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 10628us (11019us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945577.009725:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:1.0:1790945577.015571:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.015704:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254785536 00000100:00100000:2.0:1790945577.015715:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254785536 00000100:00100000:2.0:1790945577.015778:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 56 00000100:00100000:2.0:1790945577.015788:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8477f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+44:11558:x1877942254785536:12345-192.168.202.48@tcp:35:lfs.0 00000004:00010000:2.0:1790945577.015859:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54ffaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c844e expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790945577.016225:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1790945577.016511:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1790945577.016551:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1790945577.017138:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1790945577.017191:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.017206:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54ff69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c842b expref: 48 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.017216:0:5826:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.017248:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54ff69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c842b expref: 48 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.017558:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54ff69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c842b expref: 48 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945577.017573:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881605c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5826:1877942273649280:192.168.202.48@tcp:104: 00000100:00100000:2.0:1790945577.017733:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881b6ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945577.021296:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881605c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5826:1877942273649280:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945577.021323:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945577.025134:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.025277:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254785664 00000100:00100000:2.0:1790945577.025288:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254785664 00010000:00010000:2.0:1790945577.025328:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54ff69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c842b expref: 49 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945577.025367:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 75 00000100:00100000:2.0:1790945577.025376:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+49:2373:x1877942254785664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945577.025391:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945577.025398:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54ff69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c842b expref: 49 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.025411:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54ff69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c842b expref: 49 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.025432:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a54ff69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c842b expref: 49 pid: 5823 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.025463:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb843765c00) 00010000:00010000:2.0:1790945577.025469:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.025479:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.025486:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.025517:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945577.025577:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+48:2373:x1877942254785664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 201us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945577.025585:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 75 00010000:00010000:3.0:1790945577.028643:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.028724:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945577.029129:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1790945577.029390:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1790945577.029491:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873d70380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877942273649408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790945577.029544:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945577.029623:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865ed63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945577.029856:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273649408 00000100:00100000:0.0:1790945577.029865:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273649408 00000100:00080000:3.0:1790945577.030190:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945577.030352:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790945577.030362:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1877942273649408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790945577.030519:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1877942273649408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 158us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945577.030527:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790945577.030799:0:5826:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1790945577.030806:0:5826:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1790945577.030825:0:5826:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb87fe5c380, transno 4294967307 00000100:00100000:3.0:1790945577.030850:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873d70380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877942273649408:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790945577.031733:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1790945577.031795:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873d70380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877942273649536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790945577.031834:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945577.031870:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8738959c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945577.032118:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273649536 00000100:00100000:2.0:1790945577.032125:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273649536 00000100:00100000:2.0:1790945577.032165:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790945577.032174:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1877942273649536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790945577.032334:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5826:x1877942273649536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 160us (498us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790945577.032342:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790945577.032516:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873d70380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5826:1877942273649536:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790945577.032565:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1790945577.032599:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.032609:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.032617:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.032623:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865431e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945577.032627:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.032643:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.032733:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb843765c00) 00010000:00010000:3.0:1790945577.032737:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790945577.032743:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.032750:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431e00/0xc5cf2c2a6a54ffc4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790945577.032986:0:5826:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790945577.033141:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1790945577.033152:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322828494290ns, next at 323828492490ns, rc = 0 00000001:00080000:3.0:1790945577.033159:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1790945577.033189:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb843765c00) 00010000:00010000:3.0:1790945577.033192:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790945577.033198:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a54ffaf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c844e expref: 52 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945577.033438:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8477f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+51:11558:x1877942254785536:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 17651us (17876us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1790945577.033448:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 56 00000020:00080000:3.0:1790945577.033452:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790945577.036813:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.037016:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254785792 00000100:00100000:2.0:1790945577.037025:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254785792 00000100:00100000:2.0:1790945577.037111:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 202 00000100:00100000:2.0:1790945577.037122:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+51:11558:x1877942254785792:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945577.037145:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945577.037165:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a54ffcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8455 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.037234:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a54ffcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8455 expref: 52 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.037248:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a54ffcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8455 expref: 52 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.037333:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:2.0:1790945577.037337:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945577.037342:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431400, rc 0) 00000100:00100000:2.0:1790945577.037399:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+52:11558:x1877942254785792:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 279us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945577.037408:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 202 00000100:00100000:3.0:1790945577.040754:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945577.040828:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254786048 00000100:00100000:0.0:1790945577.040845:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254786048 00000100:00100000:0.0:1790945577.040897:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 57 00000100:00100000:0.0:1790945577.040906:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+52:11558:x1877942254786048:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1790945577.041109:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+53:11558:x1877942254786048:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 204us (363us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1790945577.041117:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 57 00000100:00100000:0.0:1790945577.140718:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.140812:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254786176 00000100:00100000:2.0:1790945577.140823:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254786176 00000100:00100000:2.0:1790945577.140889:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 203 00000100:00100000:2.0:1790945577.140900:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+53:11568:x1877942254786176:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:2.0:1790945577.140975:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a54ffd2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.140992:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a54ffd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141004:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a54ffd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141018:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a54ffd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141044:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a54ffd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141050:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a54ffd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141135:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a54ffe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141143:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a54ffe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141150:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a54ffe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945577.141188:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a54ffe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141199:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a54ffd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141206:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a54ffd2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141213:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a54ffd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141218:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865431c00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945577.141222:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a54ffd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141230:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a54ffd2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141250:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:2.0:1790945577.141253:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945577.141272:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a54ffd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141280:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a54ffd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141295:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a54ffd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141302:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a54ffd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141308:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a54ffd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141314:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865430e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945577.141317:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a54ffd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141322:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a54ffd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141329:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb845042600) 00010000:00010000:2.0:1790945577.141331:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945577.141334:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a54ffd9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141339:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a54ffd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141364:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a54ffe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141370:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a54ffe0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141376:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a54ffe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141382:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865430600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945577.141386:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a54ffe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141392:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a54ffe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141400:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:2.0:1790945577.141402:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945577.141405:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a54ffe0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.141411:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a54ffe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945577.141486:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+53:11568:x1877942254786176:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 586us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945577.141494:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 203 00000100:00100000:0.0:1790945577.180736:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945577.180830:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254786432 00000100:00100000:1.0:1790945577.180850:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254786432 00000100:00100000:1.0:1790945577.180909:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 204 00000100:00100000:1.0:1790945577.180919:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+53:11571:x1877942254786432:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1790945577.180941:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945577.180961:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ffe7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c845c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181028:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ffee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181041:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ffee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181051:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ffee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181064:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fff5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181070:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181076:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181195:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fffc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181204:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181211:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945577.181220:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790945577.181312:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ffee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181320:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ffee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181328:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ffee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181334:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945577.181339:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ffee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181345:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ffee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181357:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:1.0:1790945577.181360:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945577.181365:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ffee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181381:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a54ffee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181396:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181402:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fff5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181407:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fff5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181411:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133a00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945577.181415:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fff5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181420:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fff5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181428:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb843765600) 00010000:00010000:1.0:1790945577.181430:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945577.181432:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fff5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181437:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133a00/0xc5cf2c2a6a54fff5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181478:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133400/0xc5cf2c2a6a54ffe7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c845c expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181489:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fffc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c845c expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.181501:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:1.0:1790945577.181503:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945577.181505:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133600, rc 0) 00000100:00100000:1.0:1790945577.181570:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:11571:x1877942254786432:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 651us (912us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1790945577.181577:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 204 00000100:00100000:3.0:1790945577.184543:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.184642:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254786560 00000100:00100000:2.0:1790945577.184652:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254786560 00000100:00100000:2.0:1790945577.184743:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 205 00000100:00100000:2.0:1790945577.184765:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:11571:x1877942254786560:12345-192.168.202.48@tcp:54:lfs.0 00010000:00010000:2.0:1790945577.184825:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a55000a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.184853:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a55000a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.184865:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a55000a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.184895:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a55000a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.184903:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a55000a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.184910:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a55000a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.184916:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865430600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945577.184931:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a55000a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.184938:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a55000a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.184950:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:2.0:1790945577.184954:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790945577.184959:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a55000a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.184965:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a55000a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945577.185039:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:11571:x1877942254786560:12345-192.168.202.48@tcp:54:lfs.0 Request processed in 275us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945577.185046:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 205 00000100:00100000:1.0:1790945577.188389:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.188593:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254786816 00000100:00100000:2.0:1790945577.188604:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254786816 00000100:00100000:2.0:1790945577.188653:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 58 00000100:00100000:2.0:1790945577.188690:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+55:11571:x1877942254786816:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1790945577.189075:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:11571:x1877942254786816:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 386us (694us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1790945577.189084:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 58 00000100:00100000:1.0:1790945577.318720:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945577.318808:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254787072 00000100:00100000:3.0:1790945577.318819:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254787072 00000100:00100000:3.0:1790945577.318908:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 206 00000100:00100000:3.0:1790945577.318926:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+56:11581:x1877942254787072:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:3.0:1790945577.318953:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945577.318956:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790945577.318985:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a54ff8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8440 expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.319004:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:3.0:1790945577.319010:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945577.319024:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550011 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8463 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.319116:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a550018 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.319131:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a550018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.319142:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a550018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945577.319152:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790945577.319596:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550011 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8463 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.319615:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a550018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8463 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.319624:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:3.0:1790945577.319633:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945577.319637:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840031c00, rc 0) 00000100:00100000:3.0:1790945577.319748:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:11581:x1877942254787072:12345-192.168.202.48@tcp:101:bash.0 Request processed in 830us (1098us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1790945577.319755:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 206 00000100:00100000:1.0:1790945577.322517:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.322623:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254787328 00000100:00100000:2.0:1790945577.322633:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254787328 00000100:00100000:2.0:1790945577.322727:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 207 00000100:00100000:2.0:1790945577.322737:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:11581:x1877942254787328:12345-192.168.202.48@tcp:36:bash.0 00010000:00010000:2.0:1790945577.322791:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790945577.322815:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a550018 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8463 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.322851:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a54fffc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c845c expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.322862:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:2.0:1790945577.322867:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945577.323081:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a550026 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.323113:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a550026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.323121:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a550026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945577.323186:0:5824:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1790945577.323210:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b5654b1f reply state 00000000abf1f17b transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a550026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945577.323219:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790945577.323628:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:11581:x1877942254787328:12345-192.168.202.48@tcp:36:bash.0 Request processed in 890us (1117us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1790945577.323637:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 207 00000020:00080000:2.0:1790945577.323643:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790945577.329241:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a550026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.329396:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a550026 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.329426:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a550026 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.329433:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865430600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945577.329438:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a550026 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.329447:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a550026 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.329465:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:0.0:1790945577.329469:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945577.329473:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a550026 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.329480:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a550026 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945577.332240:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.332631:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254787456 00000100:00100000:2.0:1790945577.332641:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254787456 00000100:00100000:2.0:1790945577.332804:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 208 00000100:00100000:2.0:1790945577.332814:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+57:11581:x1877942254787456:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:2.0:1790945577.332848:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945577.332869:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a55002d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c846a expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.332974:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550034 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.332988:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.332999:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945577.333045:0:7211:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790945577.333049:0:7211:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945577.333069:0:7211:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.333095:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a55002d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c846a expref: 59 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.333112:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c846a expref: 58 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.333120:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:2.0:1790945577.333124:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945577.333126:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431c00, rc 0) 00000100:00100000:2.0:1790945577.335732:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:11581:x1877942254787456:12345-192.168.202.48@tcp:101:bash.0 Request processed in 2908us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945577.335744:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 208 00000100:00100000:1.0:1790945577.346445:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.346530:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254787712 00000100:00100000:2.0:1790945577.346539:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254787712 00000100:00100000:2.0:1790945577.346592:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 59 00000100:00100000:2.0:1790945577.346601:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+58:11581:x1877942254787712:12345-192.168.202.48@tcp:35:bash.0 00000100:00100000:2.0:1790945577.347131:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+59:11581:x1877942254787712:12345-192.168.202.48@tcp:35:bash.0 Request processed in 529us (693us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1790945577.347141:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 59 00000100:00100000:1.0:1790945577.428371:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.429077:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254787840 00000100:00100000:2.0:1790945577.429088:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254787840 00000100:00100000:2.0:1790945577.429203:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 209 00000100:00100000:2.0:1790945577.429212:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+59:11587:x1877942254787840:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945577.429237:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945577.429267:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a55003b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8471 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.429332:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a550042 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.429346:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a550042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.429356:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a550042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945577.429389:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790945577.429392:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945577.429409:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a550042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.429433:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a55003b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8471 expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.429450:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a550042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8471 expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.429458:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:2.0:1790945577.429462:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945577.429465:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431200, rc 0) 00000100:00100000:2.0:1790945577.429530:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:11587:x1877942254787840:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 318us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945577.429543:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 209 00000100:00100000:3.0:1790945577.433778:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945577.434097:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254787968 00000100:00100000:0.0:1790945577.434108:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254787968 00000100:00100000:0.0:1790945577.434169:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 210 00000100:00100000:0.0:1790945577.434179:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:11587:x1877942254787968:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945577.434198:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945577.434217:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a550049 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8478 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434294:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a550050 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434309:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a550050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434331:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a550050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434356:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a550057 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434364:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a550057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434370:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a550057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434456:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a55005e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434465:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a55005e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434471:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a55005e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945577.434505:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790945577.434508:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945577.434526:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a55005e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434537:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a55005e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434545:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a550050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434561:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a550050 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434569:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a550050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434576:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1ca00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945577.434580:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a550050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434587:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a550050 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434598:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:0.0:1790945577.434601:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945577.434606:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a550050 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434612:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a550050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434625:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a550057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434632:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a550057 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434638:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a550057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434644:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945577.434651:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a550057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434687:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a550057 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434696:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb8510c8700) 00010000:00010000:0.0:1790945577.434698:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945577.434701:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a550057 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434707:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d200/0xc5cf2c2a6a550057 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434742:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a550049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8478 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434754:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a55005e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8478 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.434761:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:0.0:1790945577.434763:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790945577.434765:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d400, rc 0) 00000100:00100000:0.0:1790945577.434844:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:11587:x1877942254787968:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 658us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945577.434851:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 210 00000100:00100000:1.0:1790945577.443005:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945577.443047:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945577.443108:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254788352 00000100:00100000:0.0:1790945577.443118:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254788352 00000100:00100000:0.0:1790945577.443182:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:0.0:1790945577.443193:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881475500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:2372:x1877942254788352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945577.443222:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945577.443245:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a55005e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8478 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.443282:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:0.0:1790945577.443287:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945577.443350:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881475500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:2372:x1877942254788352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 158us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945577.443357:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:3.0:1790945577.443800:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254788224 00000100:00100000:3.0:1790945577.443805:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254788224 00000100:00100000:3.0:1790945577.443840:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 211 00000100:00100000:3.0:1790945577.443848:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:11587:x1877942254788224:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945577.443864:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945577.443889:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550065 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c847f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.443986:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.444000:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550034 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c846a expref: 61 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.444009:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.444038:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c846a expref: 61 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.444052:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550034 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c846a expref: 61 pid: 7211 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945577.444078:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873d72680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877942273649664:192.168.202.48@tcp:104: 00000100:00100000:3.0:1790945577.444152:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb873895000 going to sleep for 11 seconds 00000100:00100000:3.0:1790945577.453143:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873d72680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877942273649664:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945577.453175:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945577.454648:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.454945:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254788480 00000100:00100000:2.0:1790945577.454954:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254788480 00010000:00010000:2.0:1790945577.454991:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550034 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c846a expref: 62 pid: 7211 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945577.455031:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 76 00000100:00100000:2.0:1790945577.455040:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881475c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:2373:x1877942254788480:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945577.455053:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945577.455059:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550034 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c846a expref: 62 pid: 7211 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.455071:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c846a expref: 62 pid: 7211 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.455092:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550034 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c846a expref: 62 pid: 7211 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.455109:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:2.0:1790945577.455113:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.455123:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.455131:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.455178:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945577.455240:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881475c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:2373:x1877942254788480:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 199us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945577.455248:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 76 00010000:00010000:3.0:1790945577.455555:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.455563:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945577.455581:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1790945577.455766:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550065 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c847f expref: 62 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.455785:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c847f expref: 61 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.455793:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:3.0:1790945577.455795:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790945577.455797:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840031c00, rc 0) 00000100:00100000:3.0:1790945577.455845:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:11587:x1877942254788224:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 11998us (12849us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1790945577.455852:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 211 00000100:00100000:1.0:1790945577.461092:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945577.461185:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254788736 00000100:00100000:0.0:1790945577.461196:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254788736 00000100:00100000:0.0:1790945577.461267:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:0.0:1790945577.461277:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:11587:x1877942254788736:12345-192.168.202.48@tcp:103:lfs.0 00010000:00010000:0.0:1790945577.461292:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945577.461316:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a54ffcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8455 expref: 61 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.461334:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:0.0:1790945577.461339:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945577.461398:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:11587:x1877942254788736:12345-192.168.202.48@tcp:103:lfs.0 Request processed in 122us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945577.461405:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:0.0:1790945577.464333:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945577.464455:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254788864 00000100:00100000:3.0:1790945577.464476:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254788864 00000100:00100000:3.0:1790945577.464530:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 212 00000100:00100000:3.0:1790945577.464540:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:11587:x1877942254788864:12345-192.168.202.48@tcp:58:lfs.0 00010000:00010000:3.0:1790945577.464635:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a55007a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.464651:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a55007a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.464716:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a55007a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790945577.464931:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1790945577.465016:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:11587:x1877942254788864:12345-192.168.202.48@tcp:58:lfs.0 Request processed in 476us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945577.465024:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 212 00000100:00100000:1.0:1790945577.468396:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.468482:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254788992 00000100:00100000:2.0:1790945577.468492:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254788992 00000100:00100000:2.0:1790945577.468539:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 213 00000100:00100000:2.0:1790945577.468548:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+60:11587:x1877942254788992:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945577.468568:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945577.468587:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550081 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8486 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.468640:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a55007a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.468651:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550081 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8486 expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.468707:0:5824:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a55007a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.468721:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550081 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8486 expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.468735:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:2.0:1790945577.468739:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945577.468743:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550081 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8486 expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.468765:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431c00, rc 0) 00000100:00100000:2.0:1790945577.468814:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:11587:x1877942254788992:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 266us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945577.468822:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 213 00000100:00100000:1.0:1790945577.621445:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945577.621490:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.621702:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254789120 00000100:00100000:2.0:1790945577.621713:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254789120 00000100:00100000:2.0:1790945577.621767:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 294 00000100:00100000:2.0:1790945577.621776:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254789120:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945577.621859:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254789120:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 84us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945577.621867:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 294 00000100:00100000:0.0:1790945577.622446:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254789376 00000100:00100000:0.0:1790945577.622452:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254789376 00000100:00100000:0.0:1790945577.622505:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 84 00000100:00100000:0.0:1790945577.622514:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2370:x1877942254789376:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945577.622566:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2370:x1877942254789376:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 54us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945577.622573:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 84 00000100:00080000:3.0:1790945577.622815:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945577.625874:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945577.625927:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945577.626072:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254789504 00000100:00100000:3.0:1790945577.626080:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254789504 00000100:00100000:3.0:1790945577.626139:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 148 00000100:00100000:3.0:1790945577.626146:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87397ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254789504:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945577.626205:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87397ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2371:x1877942254789504:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 59us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945577.626210:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 148 00000100:00100000:2.0:1790945577.626443:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254789248 00000100:00100000:2.0:1790945577.626447:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254789248 00000100:00100000:2.0:1790945577.626471:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00100000:2.0:1790945577.626476:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2371:x1877942254789248:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945577.626503:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2371:x1877942254789248:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945577.626507:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00080000:0.0:1790945577.626617:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790945577.692167:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790945577.883985:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790945577.883995:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790945577.884056:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 6 00000040:00080000:1.0:1790945577.884065:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790945577.884188:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8814aea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1877942273649792:192.168.202.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790945577.884332:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842bb1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945577.899034:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.899137:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254789632 00000100:00100000:2.0:1790945577.899149:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254789632 00000100:00100000:2.0:1790945577.899212:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 214 00000100:00100000:2.0:1790945577.899222:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:11588:x1877942254789632:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790945577.899262:0:5824:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790945577.899414:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:11588:x1877942254789632:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 Request processed in 192us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945577.899428:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 214 00000100:00100000:1.0:1790945577.899701:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8814aea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1877942273649792:192.168.202.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790945577.908031:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945577.916033:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254789760 00000100:00100000:0.0:1790945577.916049:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254789760 00000100:00100000:0.0:1790945577.916123:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 215 00000100:00100000:0.0:1790945577.916133:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:11588:x1877942254789760:12345-192.168.202.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790945577.916206:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a550088 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916222:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a550088 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916233:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a550088 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916257:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a55008f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916264:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a55008f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916279:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a55008f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916305:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550096 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916313:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916336:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945577.916373:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790945577.916377:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945577.916389:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916400:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a550088 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916406:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a550088 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916414:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a550088 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916420:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945577.916423:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a550088 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916430:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a550088 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916441:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a900) 00010000:00010000:0.0:1790945577.916444:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945577.916449:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a550088 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916455:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a550088 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916479:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a55008f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916484:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a55008f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916489:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a55008f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916494:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945577.916497:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a55008f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916502:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a55008f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916510:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9bb8510c8700) 00010000:00010000:0.0:1790945577.916512:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945577.916514:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a55008f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916519:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a55008f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916533:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916539:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550096 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916543:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916554:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945577.916558:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916563:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916571:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:0.0:1790945577.916573:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945577.916575:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550096 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.916580:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550096 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945577.916686:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:11588:x1877942254789760:12345-192.168.202.48@tcp:34:lhsmtool_posix.0 Request processed in 553us (8666us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945577.916697:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 215 00000100:00100000:2.0:1790945577.920487:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945577.920577:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254790016 00000100:00100000:3.0:1790945577.920587:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254790016 00000100:00100000:3.0:1790945577.920643:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 216 00000100:00100000:3.0:1790945577.920707:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+61:11588:x1877942254790016:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945577.920729:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945577.920747:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a55009d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c848d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.920838:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a5500a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.920853:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a5500a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.920864:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a5500a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945577.920875:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1790945577.920965:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a5500a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.920972:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a5500a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.920979:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a5500a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.920984:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945577.920989:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a5500a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.920996:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a5500a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.921007:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:3.0:1790945577.921016:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790945577.921022:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a5500a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.921028:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a5500a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.921069:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a55009d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c848d expref: 63 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.921080:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a900) 00010000:00010000:3.0:1790945577.921082:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945577.921086:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a55009d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c848d expref: 63 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.921096:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840031600, rc 0) 00000100:00100000:3.0:1790945577.921151:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:11588:x1877942254790016:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 447us (674us total) trans 4294967504 rc 301/301 00000100:00100000:3.0:1790945577.921157:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 216 00000100:00100000:3.0:1790945577.930356:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945577.930434:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254790144 00000100:00100000:0.0:1790945577.930444:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254790144 00000100:00100000:0.0:1790945577.930502:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 217 00000100:00100000:0.0:1790945577.930512:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:11588:x1877942254790144:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790945577.930546:0:5823:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790945577.930693:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:11588:x1877942254790144:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 Request processed in 181us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945577.930700:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 217 00000100:00100000:1.0:1790945577.934976:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945577.935055:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254790400 00000100:00100000:3.0:1790945577.935065:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254790400 00000100:00100000:3.0:1790945577.935115:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 218 00000100:00100000:3.0:1790945577.935123:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8814aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:11588:x1877942254790400:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945577.935141:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945577.935144:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790945577.935167:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a550042 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8471 expref: 62 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945577.935201:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:3.0:1790945577.935206:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945577.935217:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a5500b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8494 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790945577.939052:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1790945577.940228:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a5500b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.940260:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a5500b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.940340:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a5500b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.940418:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a5500b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8494 expref: 64 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.940442:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a5500b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8494 expref: 63 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.940452:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb845042600) 00010000:00010000:2.0:1790945577.940455:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790945577.940458:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865430e00, rc 0) 00000100:00100000:2.0:1790945577.940578:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8814aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+63:11588:x1877942254790400:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 5454us (5609us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1790945577.940587:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 218 00000100:00100000:3.0:1790945577.960515:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945577.960777:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254790656 00000100:00100000:0.0:1790945577.960788:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254790656 00000100:00100000:0.0:1790945577.960870:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 219 00000100:00100000:0.0:1790945577.960885:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+63:11588:x1877942254790656:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790945577.960940:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945577.960967:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a5500b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8494 expref: 63 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.960995:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb845042600) 00010000:00010000:0.0:1790945577.961006:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945577.961027:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5500c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961041:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5500c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961050:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5500c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961063:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a5500ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8ec53548 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961069:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a5500ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8ec53548 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961074:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a5500ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8ec53548 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961133:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5500c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961141:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5500c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961159:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5500c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961164:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945577.961168:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5500c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961175:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5500c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961184:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:0.0:1790945577.961186:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945577.961189:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5500c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961195:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5500c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961204:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a5500ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8ec53548 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961210:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a5500ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8ec53548 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961215:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a5500ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8ec53548 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961219:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945577.961222:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a5500ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8ec53548 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961238:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a5500ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8ec53548 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961245:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8ec53548 (ffff9bb8510c8700) 00010000:00010000:0.0:1790945577.961247:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945577.961250:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a5500ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8ec53548 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945577.961255:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d600/0xc5cf2c2a6a5500ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8ec53548 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945577.961340:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:11588:x1877942254790656:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 461us (833us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790945577.961347:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 219 00000100:00100000:3.0:1790945577.968721:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945577.973067:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254790784 00000100:00100000:2.0:1790945577.973083:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254790784 00000100:00100000:2.0:1790945577.973194:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 220 00000100:00100000:2.0:1790945577.973205:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+62:11588:x1877942254790784:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945577.973241:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945577.973283:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430000/0xc5cf2c2a6a5500d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c849b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.973322:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430400/0xc5cf2c2a6a5500dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.973336:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430400/0xc5cf2c2a6a5500dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.973348:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430400/0xc5cf2c2a6a5500dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.973440:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430000/0xc5cf2c2a6a5500d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c849b expref: 64 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.973459:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430400/0xc5cf2c2a6a5500dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c849b expref: 63 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945577.973467:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb845042500) 00010000:00010000:2.0:1790945577.973470:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790945577.973473:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865430400, rc 0) 00000100:00100000:2.0:1790945577.973549:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+63:11588:x1877942254790784:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 346us (4836us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945577.973557:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 220 00000100:00100000:1.0:1790945577.978713:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945577.983501:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254791040 00000100:00100000:0.0:1790945577.983515:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254791040 00000100:00100000:1.0:1790945577.983645:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 221 00000100:00100000:1.0:1790945577.983683:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+63:11588:x1877942254791040:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790945577.983764:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5500e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.983781:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5500e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.983791:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5500e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790945577.984154:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1790945577.984164:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323779506228ns, next at 324779504168ns, rc = 0 00000004:00010000:1.0:1790945577.984242:0:5824:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e442435e reply state 00000000e2994beb transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5500e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945577.984381:0:5824:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790945577.984487:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+65:11588:x1877942254791040:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 805us (5782us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1790945577.984494:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 221 00000100:00100000:2.0:1790945577.989615:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945577.992204:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254791168 00000100:00100000:1.0:1790945577.992220:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254791168 00000100:00100000:1.0:1790945577.992314:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 222 00000100:00100000:1.0:1790945577.992340:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+65:11588:x1877942254791168:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945577.992366:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945577.992387:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a5500ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c84a2 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.992447:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a5500ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84a2 expref: 66 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.992461:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a5500ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84a2 expref: 66 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945577.992494:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb845042500) 00010000:00010000:1.0:1790945577.992498:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790945577.992501:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133600, rc 0) 00000100:00100000:1.0:1790945577.992566:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+66:11588:x1877942254791168:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 228us (2960us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945577.992573:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 222 00000100:00100000:2.0:1790945577.996827:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945577.997078:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254791296 00000100:00100000:3.0:1790945577.997088:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254791296 00000100:00100000:3.0:1790945577.997148:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:3.0:1790945577.997161:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2372:x1877942254791296:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790945577.998137:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:2372:x1877942254791296:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 Request processed in 975us (1315us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1790945577.998148:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 62 00010000:00010000:0.0:1790945578.002102:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5500e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.002120:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5500e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.002128:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5500e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.002135:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945578.002140:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5500e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.002149:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5500e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.002183:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb845042500) 00010000:00010000:0.0:1790945578.002186:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790945578.002191:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5500e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.002197:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5500e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945578.022245:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945578.022711:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254791552 00000100:00100000:2.0:1790945578.022739:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254791552 00000100:00100000:2.0:1790945578.022788:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 60 00000100:00100000:2.0:1790945578.022797:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+65:11588:x1877942254791552:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790945578.023050:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+66:11588:x1877942254791552:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 253us (815us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1790945578.023058:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 60 00000100:00100000:1.0:1790945578.039112:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945578.039203:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254791808 00000100:00100000:0.0:1790945578.039214:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254791808 00000100:00100000:0.0:1790945578.039284:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 223 00000100:00100000:0.0:1790945578.039295:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+66:11588:x1877942254791808:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790945578.039415:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+66:11588:x1877942254791808:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 121us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945578.039423:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 223 00000100:00100000:3.0:1790945578.042949:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945578.047058:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254791936 00000100:00100000:1.0:1790945578.047076:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254791936 00000100:00100000:1.0:1790945578.047455:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 224 00000100:00100000:1.0:1790945578.047467:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+66:11588:x1877942254791936:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945578.047489:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945578.047512:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a5500f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c84a9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.047581:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a5500f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.047608:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a5500f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.047619:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a5500f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945578.047687:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790945578.047708:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a5500f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.047732:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132c00/0xc5cf2c2a6a5500f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84a9 expref: 68 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.047752:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a5500f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84a9 expref: 67 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.047761:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb845042500) 00010000:00010000:1.0:1790945578.047764:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790945578.047767:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133000, rc 0) 00000100:00100000:1.0:1790945578.048544:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+67:11588:x1877942254791936:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 1076us (5602us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945578.048552:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 224 00000100:00100000:3.0:1790945578.055447:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945578.055594:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254792064 00000100:00100000:0.0:1790945578.055604:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254792064 00000100:00100000:0.0:1790945578.055703:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:0.0:1790945578.055715:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88135f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+10:2372:x1877942254792064:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945578.055734:0:7919:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945578.055754:0:7919:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007df9150a/0xc5cf2c2a6a5500ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c84b0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790945578.055780:0:7919:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfa92a, blocks: 0x1 00010000:00010000:0.0:1790945578.055817:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1790945578.055822:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945578.055849:0:7919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df9150a/0xc5cf2c2a6a5500ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b0 expref: 11 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.055867:0:7919:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007df9150a/0xc5cf2c2a6a5500ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b0 expref: 11 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.055888:0:7919:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d600, rc 0) 00000100:00100000:0.0:1790945578.055944:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88135f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:2372:x1877942254792064:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 230us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945578.055952:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:0.0:1790945578.061799:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945578.062018:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254792320 00000100:00100000:1.0:1790945578.062030:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254792320 00000100:00100000:1.0:1790945578.062085:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 225 00000100:00100000:1.0:1790945578.062096:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+67:11588:x1877942254792320:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790945578.062213:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+67:11588:x1877942254792320:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 119us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945578.062236:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 225 00000100:00100000:0.0:1790945578.075983:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945578.076122:0:6670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254792448 00000100:00100000:2.0:1790945578.076134:0:6670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254792448 00000100:00100000:2.0:1790945578.076193:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:2.0:1790945578.076203:0:6670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:11588:x1877942254792448:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945578.076220:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945578.076239:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da7612a/0xc5cf2c2a6a550106 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c84b7 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.076284:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007df9150a/0xc5cf2c2a6a5500ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b0 expref: 12 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.076292:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945578.076296:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945578.076302:0:6670:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da7612a/0xc5cf2c2a6a550106 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b7 expref: 12 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.076336:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007df9150a/0xc5cf2c2a6a5500ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b0 expref: 12 pid: 7919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.076350:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007df9150a/0xc5cf2c2a6a5500ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b0 expref: 12 pid: 7919 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945578.076378:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8817ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1877942273649920:192.168.202.48@tcp:104: 00000100:00100000:2.0:1790945578.076467:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881b6ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945578.087318:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8817ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1877942273649920:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945578.087352:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004da7612a/0xc5cf2c2a6a550106 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b7 expref: 12 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.087373:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431600, rc 0) 00000100:00100000:3.0:1790945578.087435:0:6670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:11588:x1877942254792448:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 11233us (11461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945578.087461:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:0.0:1790945578.101290:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945578.101492:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254792576 00000100:00100000:2.0:1790945578.101503:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254792576 00010000:00010000:2.0:1790945578.101545:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007df9150a/0xc5cf2c2a6a5500ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b0 expref: 12 pid: 7919 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945578.101588:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 77 00000100:00100000:2.0:1790945578.101599:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88183aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:2372:x1877942254792576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945578.101615:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945578.101638:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007df9150a/0xc5cf2c2a6a5500ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b0 expref: 12 pid: 7919 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.101700:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007df9150a/0xc5cf2c2a6a5500ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b0 expref: 12 pid: 7919 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.101723:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007df9150a/0xc5cf2c2a6a5500ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b0 expref: 12 pid: 7919 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.101741:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945578.101745:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945578.101752:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004da7612a/0xc5cf2c2a6a550106 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b7 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.101783:0:5810:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da7612a/0xc5cf2c2a6a550106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b7 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.101822:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004da7612a/0xc5cf2c2a6a550106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b7 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945578.101848:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8817eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1877942273650048:192.168.202.48@tcp:105: 00000100:00100000:2.0:1790945578.101939:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881b6ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945578.120041:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945578.120158:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8817eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1877942273650048:192.168.202.48@tcp:105: 00010000:00010000:2.0:1790945578.120181:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945578.120239:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88183aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:2372:x1877942254792576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 18641us (18960us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945578.120260:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 77 00000100:00100000:1.0:1790945578.120716:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254792704 00000100:00100000:1.0:1790945578.120725:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254792704 00002000:00100000:1.0:1790945578.120775:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9bb88183b480 x1877942254792704/t0(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:274/0 lens 504/0 e 0 to 0 dl 1790945589 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945578.120785:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb88183b480 with x1877942254792704 ext(0->12) 00002000:00010000:1.0:1790945578.120790:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb88183b480 00000100:00100000:1.0:1790945578.120821:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:1.0:1790945578.120839:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88183b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+11:2372:x1877942254792704:12345-192.168.202.48@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790945578.121256:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88183b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:2372:x1877942254792704:12345-192.168.202.48@tcp:4:lhsmtool_posix.0 Request processed in 426us (1223us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1790945578.121264:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6 00002000:00100000:1.0:1790945578.121451:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9bb88183b480 x1877942254792704/t4294967320(0) o4->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:274/0 lens 504/448 e 0 to 0 dl 1790945589 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790945578.121460:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb88183b480 with x1877942254792704 ext(0->12) 00002000:00010000:1.0:1790945578.121464:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb88183b480 00000100:00100000:0.0:1790945578.139107:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945578.139398:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254792832 00000100:00100000:2.0:1790945578.139408:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254792832 00000100:00100000:2.0:1790945578.139468:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 226 00000100:00100000:2.0:1790945578.139478:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+67:11588:x1877942254792832:12345-192.168.202.48@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790945578.191574:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967496 is committed 00000001:00080000:3.0:1790945578.191596:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1790945578.191601:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:3.0:1790945578.191637:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:3.0:1790945578.191693:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1790945578.191713:0:5846:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1790945578.191733:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1790945578.191748:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb865ed63c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1790945578.191752:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb8456e5b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb86c96b000 00000020:00080000:3.0:1790945578.191754:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb8456e5a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb87fe0f800 00000020:00080000:3.0:1790945578.191768:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb881b6ed80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1790945578.191771:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb8456e5c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb881b6e0c0 00000020:00080000:3.0:1790945578.191774:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb8456e5700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb8580d3000 00000020:00080000:3.0:1790945578.191792:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1790945578.192011:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1790945578.192139:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273650176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790945578.192202:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945578.192495:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273650176 00000100:00100000:3.0:1790945578.192503:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273650176 00000100:00100000:3.0:1790945578.192549:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790945578.192557:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3292:x1877942273650176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790945578.192586:0:7919:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1790945578.192617:0:7919:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abfa929, atime: 0x6abfa929, ctime: 0x6abfa929, blocks: 0x1 00010000:00010000:3.0:1790945578.192625:0:7919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe28e06/0xc5cf2c2a6a55010d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.192688:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1790945578.192693:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945578.192700:0:7919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe28e06/0xc5cf2c2a6a55010d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.192716:0:7919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe28e06/0xc5cf2c2a6a55010d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.192725:0:7919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe28e06/0xc5cf2c2a6a55010d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.192733:0:7919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe28e06/0xc5cf2c2a6a55010d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.192749:0:7919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790945578.193242:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3292:x1877942273650176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 684us (1037us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790945578.193250:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1790945578.193418:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945578.193425:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe28e06/0xc5cf2c2a6a55010d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.193432:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031200 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945578.193437:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe28e06/0xc5cf2c2a6a55010d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.193457:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe28e06/0xc5cf2c2a6a55010d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.193474:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe28e06/0xc5cf2c2a6a55010d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.193482:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe28e06/0xc5cf2c2a6a55010d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.193505:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945578.193507:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945578.193509:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790945578.193543:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb87fe00a80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1790945578.193549:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273650176:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790945578.193749:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88179f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273650432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790945578.193786:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945578.194109:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273650432 00000100:00100000:3.0:1790945578.194115:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273650432 00000100:00100000:3.0:1790945578.194165:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790945578.194173:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3294:x1877942273650432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790945578.194451:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:11588:x1877942254792832:12345-192.168.202.48@tcp:44:lhsmtool_posix.0 Request processed in 54971us (55350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945578.194461:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 226 00002000:00010000:3.0:1790945578.196102:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790945578.196109:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790945578 00002000:00010000:3.0:1790945578.196112:0:6672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790945578.196115:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790945578 -> 1790945578 00002000:00010000:3.0:1790945578.196117:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790945578.196176:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873d3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3294:x1877942273650432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2002us (2386us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1790945578.196201:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1790945578.196388:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb88179f100/2, rc 0, transno 4294967321 00000100:00100000:1.0:1790945578.196395:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88179f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273650432:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1790945578.197062:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945578.197084:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88179ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273650304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790945578.197122:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945578.197274:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273650304 00000100:00100000:0.0:1790945578.197282:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273650304 00000100:00100000:0.0:1790945578.197325:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790945578.197335:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3293:x1877942273650304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790945578.197360:0:7919:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1790945578.197383:0:7919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.197404:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0f24abd/0xc5cf2c2a6a54fecf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8416 expref: 12 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.197423:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790945578.197427:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790945578.197431:0:7919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.197465:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0f24abd/0xc5cf2c2a6a54fecf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8416 expref: 12 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.197479:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0f24abd/0xc5cf2c2a6a54fecf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8416 expref: 12 pid: 6672 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945578.197492:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881838000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7919:1877942273650560:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945578.197558:0:7919:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb851809000 going to sleep for 11 seconds 00000100:00100000:0.0:1790945578.201669:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945578.202845:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254792960 00000100:00100000:3.0:1790945578.202859:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254792960 00000100:00100000:3.0:1790945578.202931:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:3.0:1790945578.202942:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:2373:x1877942254792960:12345-192.168.202.48@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790945578.204560:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881838000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7919:1877942273650560:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945578.204591:0:7919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945578.205317:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945578.205454:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254793088 00000100:00100000:0.0:1790945578.205461:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254793088 00010000:00010000:0.0:1790945578.205493:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0f24abd/0xc5cf2c2a6a54fecf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8416 expref: 14 pid: 6672 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945578.205535:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 78 00000100:00100000:0.0:1790945578.205544:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+14:2372:x1877942254793088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945578.205559:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945578.205565:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000e0f24abd/0xc5cf2c2a6a54fecf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8416 expref: 14 pid: 6672 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.205597:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0f24abd/0xc5cf2c2a6a54fecf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8416 expref: 14 pid: 6672 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.205622:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0f24abd/0xc5cf2c2a6a54fecf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8416 expref: 14 pid: 6672 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.205640:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1790945578.205644:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1790945578.205702:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.205712:0:5809:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.205734:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945578.205779:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+13:2372:x1877942254793088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 236us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945578.205787:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 78 00010000:00010000:3.0:1790945578.207090:0:7919:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.207106:0:7919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.207116:0:7919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.207125:0:7919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.207154:0:7919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790945578.207353:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945578.207359:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.207369:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945578.207373:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.207394:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.207412:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.207421:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001330aa66/0xc5cf2c2a6a550114 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.207440:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945578.207442:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945578.207444:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945578.208489:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3293:x1877942273650304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11152us (11361us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1790945578.208500:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1790945578.208837:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb88179ce00/2, rc 0, transno 4294967322 00000100:00100000:1.0:1790945578.208846:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88179ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273650304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790945578.282987:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+12:2373:x1877942254792960:12345-192.168.202.48@tcp:16:lhsmtool_posix.0 Request processed in 80035us (81336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945578.283001:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 68 00000001:00080000:2.0:1790945578.285042:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:2.0:1790945578.285061:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1790945578.285071:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:2.0:1790945578.285083:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:1.0:1790945578.286945:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945578.287029:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254793344 00000100:00100000:3.0:1790945578.287039:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254793344 00000100:00100000:3.0:1790945578.287101:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 227 00000100:00100000:3.0:1790945578.287113:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:11588:x1877942254793344:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790945578.287164:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945578.287191:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133000/0xc5cf2c2a6a5500f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84a9 expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.287212:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb845042500) 00010000:00010000:3.0:1790945578.287217:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790945578.287247:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55011b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.287261:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55011b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.287284:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55011b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790945578.287521:0:5825:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000085c404ed reply state 00000000d22fa214 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55011b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945578.287531:0:5825:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945578.287637:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:11588:x1877942254793344:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 526us (701us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1790945578.287644:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 227 00010000:00010000:1.0:1790945578.290290:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55011b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.290307:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55011b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.290315:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55011b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.290321:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945578.290326:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55011b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.290334:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55011b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.290351:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb845042500) 00010000:00010000:1.0:1790945578.290354:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945578.290358:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55011b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.290365:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55011b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945578.294581:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945578.294682:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254793472 00000100:00100000:3.0:1790945578.294693:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254793472 00000100:00100000:3.0:1790945578.294747:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:3.0:1790945578.294755:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2372:x1877942254793472:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790945578.295019:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1790945578.295023:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1790945578 -> 1790945577 00002000:00010000:3.0:1790945578.295026:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790945577 00002000:00010000:3.0:1790945578.295028:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790945578 -> 1790945577 00002000:00010000:3.0:1790945578.295030:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790945578.295097:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2372:x1877942254793472:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 Request processed in 342us (524us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1790945578.295104:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:3.0:1790945578.302796:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945578.302995:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254793728 00000100:00100000:1.0:1790945578.303006:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254793728 00000100:00100000:1.0:1790945578.303083:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 228 00000100:00100000:1.0:1790945578.303093:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:11588:x1877942254793728:12345-192.168.202.48@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790945578.303160:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.303176:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430400/0xc5cf2c2a6a5500dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c849b expref: 21 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.303186:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.303223:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430400/0xc5cf2c2a6a5500dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c849b expref: 21 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.303237:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430400/0xc5cf2c2a6a5500dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c849b expref: 21 pid: 5825 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945578.303251:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88179c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877942273650688:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945578.303358:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85209d600 going to sleep for 11 seconds 00000100:00100000:1.0:1790945578.308247:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88179c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5824:1877942273650688:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945578.308290:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945578.309938:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945578.311404:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254793856 00000100:00100000:1.0:1790945578.311420:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254793856 00010000:00010000:1.0:1790945578.311467:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430400/0xc5cf2c2a6a5500dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c849b expref: 22 pid: 5825 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945578.311534:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00100000:1.0:1790945578.311544:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:2373:x1877942254793856:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945578.311561:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945578.311568:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430400/0xc5cf2c2a6a5500dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c849b expref: 22 pid: 5825 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.311583:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430400/0xc5cf2c2a6a5500dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c849b expref: 22 pid: 5825 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.311604:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430400/0xc5cf2c2a6a5500dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c849b expref: 22 pid: 5825 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.311622:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb845042500) 00010000:00010000:1.0:1790945578.311626:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.311636:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.311643:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.311731:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945578.311784:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:2373:x1877942254793856:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 241us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945578.311792:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 79 00010000:00010000:0.0:1790945578.311870:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.311891:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.311917:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.311924:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.311931:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.311937:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945578.311949:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.311957:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.311966:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb845042500) 00010000:00010000:0.0:1790945578.311969:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790945578.311972:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.311978:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133e00/0xc5cf2c2a6a550122 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945578.312021:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:11588:x1877942254793728:12345-192.168.202.48@tcp:55:lhsmtool_posix.0 Request processed in 8929us (9234us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790945578.312029:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 228 00000100:00100000:2.0:1790945578.330927:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945578.331113:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254793984 00000100:00100000:3.0:1790945578.331123:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254793984 00000100:00100000:3.0:1790945578.331176:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 70 00000100:00100000:3.0:1790945578.331184:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2373:x1877942254793984:12345-192.168.202.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790945578.331224:0:7919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.331242:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004da7612a/0xc5cf2c2a6a550106 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b7 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.331251:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790945578.331254:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945578.331280:0:7919:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.331312:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004da7612a/0xc5cf2c2a6a550106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b7 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.331326:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004da7612a/0xc5cf2c2a6a550106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b7 expref: 8 pid: 6670 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945578.331340:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7919:1877942273650816:192.168.202.48@tcp:104: 00000100:00100000:3.0:1790945578.331476:0:7919:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881032e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945578.337679:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945578.339320:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7919:1877942273650816:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945578.339351:0:7919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945578.339543:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254794112 00000100:00100000:1.0:1790945578.339568:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254794112 00010000:00010000:1.0:1790945578.339604:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004da7612a/0xc5cf2c2a6a550106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b7 expref: 9 pid: 6670 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945578.339738:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 80 00000100:00100000:1.0:1790945578.339749:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+9:2372:x1877942254794112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945578.339767:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945578.339789:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004da7612a/0xc5cf2c2a6a550106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b7 expref: 9 pid: 6670 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.339803:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004da7612a/0xc5cf2c2a6a550106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b7 expref: 9 pid: 6670 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.339824:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da7612a/0xc5cf2c2a6a550106 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84b7 expref: 9 pid: 6670 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.339852:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790945578.339857:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790945578.339864:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.339883:0:5809:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.339912:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945578.339986:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2372:x1877942254794112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 234us (2342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945578.340003:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 80 00010000:00010000:3.0:1790945578.340088:0:7919:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.340098:0:7919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.340122:0:7919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.340131:0:7919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.340151:0:7919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.340158:0:7919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945578.340163:0:7919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.340173:0:7919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.340185:0:7919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.340193:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf942db2/0xc5cf2c2a6a550129 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945578.340237:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2373:x1877942254793984:12345-192.168.202.48@tcp:1:lhsmtool_posix.0 Request processed in 9053us (9327us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945578.340245:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 70 00000100:00100000:3.0:1790945578.345632:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945578.345760:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254794368 00000100:00100000:0.0:1790945578.345770:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254794368 00000100:00100000:0.0:1790945578.345840:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 229 00000100:00100000:0.0:1790945578.345849:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:11588:x1877942254794368:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790945578.345943:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a550130 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.345961:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a550130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.345972:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a550130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.346195:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.346207:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a5500ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84a2 expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.346215:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.346250:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a5500ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84a2 expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945578.346277:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a5500ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84a2 expref: 21 pid: 5824 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945578.346292:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88183b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877942273650944:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945578.346373:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8518093c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945578.350811:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88183b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877942273650944:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945578.350850:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945578.352467:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945578.352859:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254794496 00000100:00100000:2.0:1790945578.352870:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254794496 00010000:00010000:2.0:1790945578.352918:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a5500ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84a2 expref: 22 pid: 5824 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945578.352958:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:2.0:1790945578.352968:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:2372:x1877942254794496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945578.352983:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945578.352989:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a5500ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84a2 expref: 22 pid: 5824 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.353002:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a5500ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84a2 expref: 22 pid: 5824 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.353023:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133600/0xc5cf2c2a6a5500ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84a2 expref: 22 pid: 5824 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.353039:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb845042500) 00010000:00010000:2.0:1790945578.353043:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.353052:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.353058:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.353084:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945578.353146:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:2372:x1877942254794496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 179us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945578.353153:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 81 00010000:00010000:2.0:1790945578.353243:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.353251:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945578.353416:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1790945578.353559:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1790945578.353605:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1790945578.353723:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8817ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5825:1877942273651072:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790945578.353769:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945578.353793:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb873895f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945578.353810:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273651072 00000100:00100000:2.0:1790945578.353814:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273651072 00000100:00100000:2.0:1790945578.353844:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790945578.353851:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1877942273651072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790945578.353913:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1877942273651072:12345-0@lo:1000:mdt00_002.0 Request processed in 62us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945578.354241:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790945578.354582:0:5825:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1790945578.354587:0:5825:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1790945578.354607:0:5825:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb88179f100, transno 4294967321 00000004:00080000:2.0:1790945578.354676:0:5825:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb88179ce00, transno 4294967322 00000100:00100000:2.0:1790945578.357128:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8817ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5825:1877942273651072:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1790945578.358092:0:5825:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1790945578.358175:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8817ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5825:1877942273651200:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790945578.358246:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945578.358396:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb873895b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945578.358438:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273651200 00000100:00100000:0.0:1790945578.358446:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273651200 00000100:00100000:0.0:1790945578.358524:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790945578.358535:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1877942273651200:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790945578.358766:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5825:x1877942273651200:12345-0@lo:1000:mdt00_002.0 Request processed in 233us (520us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1790945578.358774:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790945578.358863:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8817ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5825:1877942273651200:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1790945578.358905:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.358939:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.358946:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.358953:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945578.358957:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.358966:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.358981:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb845042500) 00010000:00010000:3.0:1790945578.358984:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945578.358990:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.358996:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550137 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.359026:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a55007a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.359033:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a55007a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.359039:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a55007a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.359045:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945578.359055:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a55007a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.359062:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a55007a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.359070:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:3.0:1790945578.359073:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945578.359080:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550081 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8486 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.359091:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550081 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8486 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.359101:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550081 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8486 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.359125:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550081 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8486 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945578.359136:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe00700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877942273651328:192.168.202.48@tcp:105: 00000100:00100000:3.0:1790945578.359199:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881032e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790945578.362765:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945578.362799:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254794624 00000100:00100000:3.0:1790945578.362809:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254794624 00000100:00100000:1.0:1790945578.362991:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe00700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5825:1877942273651328:192.168.202.48@tcp:105: 00010000:00010000:1.0:1790945578.363017:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a55007a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363028:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a55007a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363058:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a55013e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363072:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a55013e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363082:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a55013e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363093:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a55013e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363099:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a55013e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363105:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a55013e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363109:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132a00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945578.363113:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a55013e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363120:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a55013e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363146:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:1.0:1790945578.363149:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945578.363153:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a55013e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363159:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132a00/0xc5cf2c2a6a55013e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363170:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a550130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363175:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a550130 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363180:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a550130 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363185:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945578.363187:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a550130 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363193:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a550130 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363200:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:1.0:1790945578.363203:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790945578.363206:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a550130 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945578.363212:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c000/0xc5cf2c2a6a550130 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790945578.363506:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790945578.363511:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790945578.363952:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1790945578.363959:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790945578.364051:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+25:11588:x1877942254794368:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 18201us (18426us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1790945578.364062:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 229 00000020:00080000:1.0:1790945578.364067:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1790945578.364968:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:3.0:1790945578.365119:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+24:11587:x1877942254794624:12345-192.168.202.48@tcp:49:lfs.0 00000100:00100000:3.0:1790945578.365229:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+24:11587:x1877942254794624:12345-192.168.202.48@tcp:49:lfs.0 Request processed in 250us (2473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945578.365245:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:3.0:1790945578.368314:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945578.368598:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254794880 00000100:00100000:2.0:1790945578.368609:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254794880 00000100:00100000:2.0:1790945578.368697:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:2.0:1790945578.368707:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8477f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+24:11588:x1877942254794880:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790945578.369560:0:5826:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790945578.369700:0:5826:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1790945578.369749:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a550145 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.369765:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a550145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.369776:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a550145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.369784:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a550145 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.369791:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a550145 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.369797:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a550145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.369814:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790945578.369898:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8477f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+26:11588:x1877942254794880:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 1191us (1590us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1790945578.369906:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 62 00000020:00080000:2.0:1790945578.369920:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790945578.371163:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945578.371175:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a550145 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.371183:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865431400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945578.371187:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a550145 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.371195:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a550145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.371209:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bb845042100) 00010000:00010000:3.0:1790945578.371212:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790945578.371217:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a550145 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.371222:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431400/0xc5cf2c2a6a550145 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.371241:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945578.371243:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945578.371244:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945578.377593:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945578.378386:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254795136 00000100:00100000:0.0:1790945578.378397:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254795136 00000100:00100000:0.0:1790945578.378489:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 230 00000100:00100000:0.0:1790945578.378514:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+26:11587:x1877942254795136:12345-192.168.202.48@tcp:58:lfs.0 00000040:00080000:0.0:1790945578.378799:0:7211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1790945578.379096:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+26:11587:x1877942254795136:12345-192.168.202.48@tcp:58:lfs.0 Request processed in 582us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945578.379104:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 230 00000100:00100000:1.0:1790945578.414502:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945578.414691:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254795264 00000100:00100000:3.0:1790945578.414702:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254795264 00000100:00100000:3.0:1790945578.414762:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 231 00000100:00100000:3.0:1790945578.414772:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+26:11591:x1877942254795264:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945578.414792:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945578.414825:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a55014c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c84be expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.414917:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a550153 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.414931:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a550153 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.414948:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a550153 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.414963:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55015a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.414971:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55015a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.414978:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55015a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.415202:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.415214:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c847f expref: 27 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.415222:0:5823:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550161 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.415255:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c847f expref: 27 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.415574:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c847f expref: 27 pid: 5825 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945578.415588:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273651456:192.168.202.48@tcp:104: 00000100:00100000:2.0:1790945578.415765:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8810323c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945578.423082:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945578.423209:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5823:1877942273651456:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945578.423234:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945578.424259:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254795520 00000100:00100000:0.0:1790945578.424278:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254795520 00000100:00100000:0.0:1790945578.424326:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:0.0:1790945578.424335:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+28:5612:x1877942254795520:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790945578.424554:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:5612:x1877942254795520:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 219us (1479us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1790945578.424563:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:1.0:1790945578.427255:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945578.427395:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254795648 00000100:00100000:2.0:1790945578.427404:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254795648 00010000:00010000:2.0:1790945578.427437:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c847f expref: 29 pid: 5825 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945578.427476:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 82 00000100:00100000:2.0:1790945578.427484:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:2372:x1877942254795648:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945578.427497:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945578.427503:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c847f expref: 29 pid: 5825 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.427514:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c847f expref: 29 pid: 5825 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.427533:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031c00/0xc5cf2c2a6a55006c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c847f expref: 29 pid: 5825 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.427552:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:2.0:1790945578.427557:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.427565:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.427586:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550161 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945578.427621:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945578.427718:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+28:2372:x1877942254795648:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 233us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945578.427726:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 82 00010000:00010000:3.0:1790945578.427870:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.427879:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945578.427936:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790945578.427941:0:5823:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790945578.427959:0:5823:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.427970:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.427979:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a550153 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.427986:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a550153 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.427993:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a550153 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.427999:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840030e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945578.428011:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a550153 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.428019:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a550153 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.428028:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:3.0:1790945578.428031:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945578.428035:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a550153 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.428042:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030e00/0xc5cf2c2a6a550153 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.428052:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55015a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.428059:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55015a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.428064:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55015a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.428069:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945578.428072:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55015a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.428078:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55015a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.428085:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bb85a4d2900) 00010000:00010000:3.0:1790945578.428088:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945578.428097:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55015a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.428103:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031200/0xc5cf2c2a6a55015a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.428141:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030000/0xc5cf2c2a6a55014c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84be expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.428154:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84be expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945578.428161:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:3.0:1790945578.428163:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945578.428165:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb840031600, rc 0) 00000100:00100000:3.0:1790945578.428204:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:11591:x1877942254795264:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 13433us (13710us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945578.428211:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 231 00010000:00010000:0.0:1790945578.717097:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790945579.305650:0:12440:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790945579.305728:0:12440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790945579.305783:0:12440:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1790945579.305791:0:12440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1790945579.421301:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945579.421309:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945579.421346:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790945579.421357:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790945579.421486:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8817ed500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1877942273651584:192.168.202.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790945579.421577:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8654ab840 going to sleep for 11 seconds 00000100:00100000:1.0:1790945579.427511:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8817ed500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1877942273651584:192.168.202.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790945579.430627:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945579.431592:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254795776 00000100:00100000:0.0:1790945579.431609:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254795776 00000100:00080000:2.0:1790945579.431687:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945579.431712:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 232 00000100:00100000:0.0:1790945579.431723:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:11603:x1877942254795776:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790945579.431757:0:5824:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790945579.431865:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:11603:x1877942254795776:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 Request processed in 144us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945579.431873:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 232 00000100:00100000:0.0:1790945579.438156:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945579.438273:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254796032 00000100:00100000:1.0:1790945579.438285:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254796032 00000100:00100000:1.0:1790945579.438343:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 233 00000100:00100000:1.0:1790945579.438353:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+27:11603:x1877942254796032:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945579.438374:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945579.438395:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a550168 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c84c5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945579.438486:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a55016f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945579.438500:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a55016f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945579.438511:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a55016f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945579.438529:0:5825:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790945579.438679:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a550168 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84c5 expref: 30 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945579.438696:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a55016f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84c5 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945579.438705:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:1.0:1790945579.438708:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945579.438711:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133800, rc 0) 00000100:00100000:1.0:1790945579.438771:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88183bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:11603:x1877942254796032:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 420us (625us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1790945579.438778:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 233 00000100:00100000:2.0:1790945579.449565:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945579.449653:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945579.449775:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254796416 00000100:00100000:3.0:1790945579.449787:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254796416 00000100:00100000:3.0:1790945579.449858:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 17 00000100:00100000:3.0:1790945579.449878:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86cad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:2370:x1877942254796416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945579.449892:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945579.449916:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a55016f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84c5 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945579.449956:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:3.0:1790945579.449961:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945579.450015:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86cad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+28:2370:x1877942254796416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 148us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945579.450023:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 17 00000100:00100000:0.0:1790945579.451111:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254796288 00000100:00100000:0.0:1790945579.451120:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254796288 00000100:00100000:3.0:1790945579.451680:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 234 00000100:00100000:3.0:1790945579.451691:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+28:11603:x1877942254796288:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790945579.451767:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a55017d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945579.451784:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a55017d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945579.451796:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a55017d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945579.452377:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a55017d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945579.452387:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a55017d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945579.452394:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a55017d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945579.452400:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945579.452404:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a55017d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945579.452428:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a55017d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945579.452441:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:3.0:1790945579.452444:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790945579.452449:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a55017d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945579.452454:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c4000/0xc5cf2c2a6a55017d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945579.452622:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:11603:x1877942254796288:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 930us (3061us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1790945579.452633:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 234 00000040:00080000:0.0:1790945579.452836:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790945579.452841:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790945579.453624:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790945579.453649:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790945579.464994:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945579.468753:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254796672 00000100:00100000:0.0:1790945579.468770:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254796672 00000100:00100000:0.0:1790945579.468950:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:0.0:1790945579.468962:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86543b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+29:11603:x1877942254796672:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790945579.469206:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86543b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:11603:x1877942254796672:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 246us (4221us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1790945579.469213:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 64 00010000:00010000:3.0:1790945579.739813:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945580.765687:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945580.835867:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273651712:0@lo:400:kworker.0 00000100:00100000:2.0:1790945580.835947:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945580.836044:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273651712 00000100:00100000:3.0:1790945580.836053:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273651712 00000100:00100000:3.0:1790945580.836102:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1790945580.836112:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273651712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945580.847939:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273651840:0@lo:400:kworker.0 00000100:00100000:1.0:1790945580.848019:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945580.848075:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945580.848083:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273651968:0@lo:400:kworker.0 00000100:00100000:1.0:1790945580.848107:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945580.848136:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273652096:0@lo:400:kworker.0 00000100:00100000:1.0:1790945580.848162:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945580.848196:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273651840 00000100:00100000:1.0:1790945580.848204:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273651840 00000100:00100000:1.0:1790945580.848249:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273651968 00000100:00100000:1.0:1790945580.848252:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273651968 00000100:00100000:1.0:1790945580.848289:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790945580.848312:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273651840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945580.848369:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273651840:12345-0@lo:400:kworker.0 Request processed in 58us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945580.848376:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790945580.848395:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790945580.848403:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273651968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945580.848431:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273651968:12345-0@lo:400:kworker.0 Request processed in 30us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945580.848437:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790945580.848492:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273651968:0@lo:400:kworker.0 00000100:00100000:1.0:1790945580.848503:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273651840:0@lo:400:kworker.0 00000100:00080000:2.0:1790945580.849601:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945580.849735:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273651712:12345-0@lo:400:kworker.0 Request processed in 13619us (13782us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945580.849747:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1790945580.849785:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273652096 00000100:00100000:3.0:1790945580.849791:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273652096 00000100:00100000:3.0:1790945580.849835:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790945580.849843:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3294:x1877942273652096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945580.849894:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3294:x1877942273652096:12345-0@lo:400:kworker.0 Request processed in 53us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945580.849911:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1790945580.849930:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945580.849957:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273652096:0@lo:400:kworker.0 00000100:00100000:0.0:1790945580.850296:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945580.850308:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273652352:0@lo:400:kworker.0 00000100:00100000:0.0:1790945580.850343:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945580.850537:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273652352 00000100:00100000:1.0:1790945580.850542:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273652352 00000100:00100000:1.0:1790945580.850570:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790945580.850577:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273652352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945580.850631:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273652352:12345-0@lo:400:kworker.0 Request processed in 39us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945580.850639:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790945580.852584:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945580.852602:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273652224:0@lo:400:kworker.0 00000100:00100000:3.0:1790945580.852684:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790945580.852728:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945580.852747:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273652224 00000100:00100000:3.0:1790945580.852754:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273652224 00000100:00100000:3.0:1790945580.852801:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790945580.852808:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273652224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945580.852861:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1877942273652224:12345-0@lo:400:kworker.0 Request processed in 54us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945580.852869:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1790945580.852887:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945580.852910:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1877942273652224:0@lo:400:kworker.0 00000100:00100000:1.0:1790945580.853831:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273652352:0@lo:400:kworker.0 00000100:00100000:2.0:1790945580.857652:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273651712:0@lo:400:kworker.0 00000040:00080000:0.0:1790945581.206247:0:12491:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790945581.206256:0:12491:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790945581.206297:0:12491:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790945581.206303:0:12491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790945581.347958:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273652480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945581.348026:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945581.348094:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273652480 00000100:00100000:3.0:1790945581.348102:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273652480 00000100:00100000:3.0:1790945581.348144:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790945581.348153:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273652480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945581.348185:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790945581.348231:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273652480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945581.348245:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790945581.348293:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273652480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945581.353115:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273652608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945581.353188:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945581.353256:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273652608 00000100:00100000:2.0:1790945581.353265:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273652608 00000100:00100000:2.0:1790945581.353314:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790945581.353322:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1877942273652608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945581.353595:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945581.353673:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1877942273652608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 334us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945581.353681:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790945581.357102:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273652608:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1790945581.451568:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1790945581.451591:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1790945581.451602:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:3.0:1790945581.554217:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945581.554437:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254796928 00000100:00100000:0.0:1790945581.554457:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254796928 00000100:00080000:3.0:1790945581.554583:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945581.555335:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 235 00000100:00100000:0.0:1790945581.555348:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+30:11623:x1877942254796928:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1790945581.555371:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945581.555391:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a550184 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c84cc expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945581.555499:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a55018b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945581.555529:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a55018b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945581.555543:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a55018b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945581.555555:0:5823:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790945581.555708:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1da00/0xc5cf2c2a6a550184 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84cc expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945581.555726:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a55018b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84cc expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945581.555735:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:0.0:1790945581.555737:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790945581.555741:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c200, rc 0) 00000100:00100000:0.0:1790945581.555796:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+32:11623:x1877942254796928:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 452us (1590us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1790945581.555803:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 235 00000100:00100000:3.0:1790945581.568239:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945581.568519:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254797056 00000100:00100000:1.0:1790945581.568529:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254797056 00000100:00100000:1.0:1790945581.568585:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 236 00000100:00100000:1.0:1790945581.568594:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+32:11623:x1877942254797056:12345-192.168.202.48@tcp:54:lfs.0 00010000:00010000:1.0:1790945581.568744:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a550199 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945581.568784:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a550199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945581.568804:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a550199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945581.568833:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a550199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945581.568840:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a550199 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945581.568918:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a550199 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945581.568925:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945581.568930:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a550199 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945581.568938:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a550199 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945581.568951:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:1.0:1790945581.568954:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790945581.568959:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a550199 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945581.568966:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a550199 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945581.569047:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+32:11623:x1877942254797056:12345-192.168.202.48@tcp:54:lfs.0 Request processed in 453us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945581.569062:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 236 00000100:00100000:2.0:1790945581.749762:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945581.749987:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254797184 00000100:00100000:3.0:1790945581.749998:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254797184 00000100:00100000:3.0:1790945581.750062:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 71 00000100:00100000:3.0:1790945581.750069:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2372:x1877942254797184:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1790945581.750086:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945581.750106:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5501a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c84d3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790945581.750126:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6abfa929, atime: 0x6abfa929, ctime: 0x6abfa929, blocks: 0xb 00010000:00010000:3.0:1790945581.750142:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=327s v=(0 0) 00010000:00010000:3.0:1790945581.750145:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945581.750152:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5501a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84d3 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945581.750165:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5501a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84d3 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945581.750175:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4000, rc 0) 00000100:00100000:3.0:1790945581.750228:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2372:x1877942254797184:12345-192.168.202.48@tcp:101:cat.0 Request processed in 160us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945581.750242:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 71 00000100:00080000:0.0:1790945581.750300:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790945581.758708:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945581.759198:0:6677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254797312 00000100:00100000:3.0:1790945581.759211:0:6677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254797312 00002000:00100000:3.0:1790945581.759265:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9bb865438000 x1877942254797312/t0(0) o3->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:277/0 lens 488/0 e 0 to 0 dl 1790945592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945581.759276:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb865438000 with x1877942254797312 ext(0->4095) 00002000:00010000:3.0:1790945581.759282:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb865438000 00000100:00100000:3.0:1790945581.759314:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:3.0:1790945581.759323:0:6677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2371:x1877942254797312:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1790945581.759528:0:6677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2371:x1877942254797312:12345-192.168.202.48@tcp:3:cat.0 Request processed in 205us (831us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790945581.759535:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7 00002000:00100000:3.0:1790945581.759542:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9bb865438000 x1877942254797312/t0(0) o3->c6be5708-366a-4e39-b76f-5dba2d1f1a3b@192.168.202.48@tcp:277/0 lens 488/4536 e 0 to 0 dl 1790945592 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790945581.759551:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bb865438000 with x1877942254797312 ext(0->4095) 00002000:00010000:3.0:1790945581.759553:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bb865438000 00010000:00010000:3.0:1790945581.787910:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945582.741764:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945582.741802:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945582.741825:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945582.741844:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945582.741866:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945582.741895:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254797440 00000100:00100000:0.0:1790945582.741904:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254797440 00000100:00100000:0.0:1790945582.741949:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 296 00000100:00100000:0.0:1790945582.741967:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254797440:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945582.742040:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+13:2370:x1877942254797440:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 75us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945582.742047:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 296 00000100:00100000:0.0:1790945582.742081:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254797696 00000100:00100000:0.0:1790945582.742085:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254797696 00000100:00100000:0.0:1790945582.742117:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254797824 00000100:00100000:0.0:1790945582.742120:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254797824 00000100:00100000:0.0:1790945582.742138:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 88 00000100:00100000:0.0:1790945582.742144:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254797696:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945582.742173:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2370:x1877942254797696:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 29us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945582.742179:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 88 00000100:00100000:0.0:1790945582.742190:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 89 00000100:00100000:0.0:1790945582.742195:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2370:x1877942254797824:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945582.742217:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+8:2370:x1877942254797824:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 22us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945582.742222:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 89 00000100:00100000:0.0:1790945582.742238:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254797952 00000100:00100000:0.0:1790945582.742241:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254797952 00000100:00100000:0.0:1790945582.742267:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254797568 00000100:00100000:0.0:1790945582.742270:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254797568 00000100:00100000:0.0:1790945582.742286:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 152 00000100:00100000:0.0:1790945582.742292:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254797952:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945582.742319:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2370:x1877942254797952:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945582.742332:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 152 00000100:00100000:0.0:1790945582.742345:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 153 00000100:00100000:0.0:1790945582.742351:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+32:2370:x1877942254797568:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945582.742377:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+32:2370:x1877942254797568:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945582.742382:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 153 00000100:00080000:0.0:1790945582.742512:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790945582.742517:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790945582.811998:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790945583.469490:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1790945583.469528:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bb8738953c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1790945583.469534:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb86544da00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bb851c47180 00000020:00080000:3.0:1790945583.469538:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bb86544d300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bb851705400 00000020:00080000:3.0:1790945583.469576:0:5846:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1790945583.469947:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1790945583.470131:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1790945583.482729:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1790945583.482749:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:3.0:1790945583.835818:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945584.860476:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945585.884866:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945585.948773:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88179c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273652864:0@lo:400:kworker.0 00000100:00100000:1.0:1790945585.948847:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945585.948894:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88179d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273652736:0@lo:400:kworker.0 00000100:00100000:1.0:1790945585.948896:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88179d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273653376:0@lo:400:kworker.0 00000100:00100000:1.0:1790945585.948923:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945585.948925:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945585.948963:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945585.948970:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88179dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273652992:0@lo:400:kworker.0 00000100:00100000:3.0:1790945585.948979:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273652736 00000100:00100000:3.0:1790945585.948987:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273652736 00000100:00100000:1.0:1790945585.949012:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945585.949024:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1790945585.949033:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273652736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945585.949082:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273652736:12345-0@lo:400:kworker.0 Request processed in 50us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945585.949088:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1790945585.949507:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88179df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273653120:0@lo:400:kworker.0 00000100:00100000:0.0:1790945585.949535:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945585.949571:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273652864 00000100:00100000:0.0:1790945585.949588:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273652864 00000100:00100000:0.0:1790945585.949622:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273652992 00000100:00100000:0.0:1790945585.949625:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273652992 00000100:00100000:0.0:1790945585.949679:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790945585.949687:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273652864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945585.949728:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273652864:12345-0@lo:400:kworker.0 Request processed in 42us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945585.949734:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790945585.949748:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790945585.949753:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273652992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945585.949780:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273652992:12345-0@lo:400:kworker.0 Request processed in 26us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945585.949794:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790945585.949821:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273653376 00000100:00100000:0.0:1790945585.949825:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273653376 00000100:00100000:0.0:1790945585.949851:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273653120 00000100:00100000:0.0:1790945585.949853:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273653120 00000100:00100000:0.0:1790945585.949872:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790945585.949880:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273653376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945585.949911:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273653376:12345-0@lo:400:kworker.0 Request processed in 34us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945585.949916:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790945585.949927:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790945585.949932:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273653120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945585.949961:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273653120:12345-0@lo:400:kworker.0 Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945585.949967:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1790945585.949988:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790945585.949991:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945585.949994:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945585.950024:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1790945585.950030:0:3294:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1790945585.950048:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb87fe00a80, transno 4294967310 00000100:00100000:0.0:1790945585.950061:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88179df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273653120:0@lo:400:kworker.0 00000100:00100000:0.0:1790945585.950392:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88179dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273652992:0@lo:400:kworker.0 00000100:00100000:0.0:1790945585.950403:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88179c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273652864:0@lo:400:kworker.0 00000100:00100000:0.0:1790945585.950409:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1790945585.950419:0:3292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1790945585.950438:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88179d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273653376:0@lo:400:kworker.0 00000100:00100000:2.0:1790945585.963824:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88179d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273652736:0@lo:400:kworker.0 00000100:00100000:2.0:1790945585.963840:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88179e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273653248:0@lo:400:kworker.0 00000100:00100000:2.0:1790945585.963907:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945585.964107:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273653248 00000100:00100000:0.0:1790945585.964116:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273653248 00000100:00100000:0.0:1790945585.964196:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790945585.964205:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86543ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273653248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945585.964269:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86543ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273653248:12345-0@lo:400:kworker.0 Request processed in 64us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945585.964275:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1790945585.964432:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945585.964518:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88179e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273653248:0@lo:400:kworker.0 00000100:00100000:0.0:1790945586.460138:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273653504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945586.460209:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945586.460291:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273653504 00000100:00100000:0.0:1790945586.460299:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273653504 00000100:00100000:0.0:1790945586.460347:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790945586.460356:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273653504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945586.460394:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945586.460438:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273653504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945586.460444:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790945586.460489:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273653504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945586.467631:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945586.467654:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273653632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945586.467734:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945586.473341:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273653632 00000100:00100000:3.0:1790945586.473362:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273653632 00000100:00100000:3.0:1790945586.473431:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790945586.473441:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86543b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273653632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790945586.473480:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790945586.473950:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86543b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273653632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 509us (6214us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945586.473958:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790945586.478188:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273653632:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790945586.908231:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945587.654893:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945587.655043:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254798080 00000100:00100000:0.0:1790945587.655053:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254798080 00000100:00100000:0.0:1790945587.655127:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 237 00000100:00100000:0.0:1790945587.655137:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86543bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:11276:x1877942254798080:12345-192.168.202.48@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790945587.655239:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86543bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:11276:x1877942254798080:12345-192.168.202.48@tcp:60:lhsmtool_posix.0 Request processed in 103us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945587.655259:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 237 00000100:00080000:2.0:1790945587.655497:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945587.668068:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945587.668187:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254798336 00000100:00100000:2.0:1790945587.668198:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254798336 00000100:00100000:2.0:1790945587.668259:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:2.0:1790945587.668270:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:11276:x1877942254798336:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790945587.669545:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:11276:x1877942254798336:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 1272us (1483us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1790945587.669556:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:3.0:1790945587.864334:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945587.864738:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254798464 00000100:00100000:0.0:1790945587.864855:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254798464 00000100:00100000:0.0:1790945587.864912:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 298 00000100:00100000:0.0:1790945587.864923:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2373:x1877942254798464:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945587.865005:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bee3b157-ad31-4030-99ec-031c727e7689+13:2373:x1877942254798464:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 84us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945587.865013:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 298 00000100:00100000:3.0:1790945587.865904:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945587.865941:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945587.866036:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945587.866093:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254798848 00000100:00100000:0.0:1790945587.866099:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254798848 00000100:00100000:0.0:1790945587.866158:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 157 00000100:00100000:0.0:1790945587.866167:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2372:x1877942254798848:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945587.866224:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2372:x1877942254798848:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 57us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945587.866231:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 157 00000100:00080000:2.0:1790945587.867122:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945587.869596:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254798720 00000100:00100000:1.0:1790945587.869613:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254798720 00000100:00100000:1.0:1790945587.869754:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254798592 00000100:00100000:1.0:1790945587.869758:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254798592 00000100:00100000:1.0:1790945587.869796:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 92 00000100:00100000:1.0:1790945587.869807:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2372:x1877942254798720:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945587.869894:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2372:x1877942254798720:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 89us (3951us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945587.869902:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 92 00000100:00100000:1.0:1790945587.869933:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 93 00000100:00100000:1.0:1790945587.869940:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2373:x1877942254798592:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945587.869969:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2373:x1877942254798592:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 30us (3934us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945587.869975:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 93 00000100:00080000:2.0:1790945587.872184:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790945587.872196:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790945587.932002:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1790945588.640910:0:5846:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1790945588.640952:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1790945588.641133:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1790945588.641144:0:5857:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1790945588.700151:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790945588.700161:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945588.700463:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1790945588.700474:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790945588.956144:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945589.980892:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790945590.588633:0:12696:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:53:08 (1790945588) 00010000:00010000:1.0:1790945591.010319:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945591.084164:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88183aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273653760:0@lo:400:kworker.0 00000100:00100000:0.0:1790945591.086504:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945591.086591:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273654272:0@lo:400:kworker.0 00000100:00100000:0.0:1790945591.086634:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945591.086682:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945591.086688:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273654144:0@lo:400:kworker.0 00000100:00100000:0.0:1790945591.086717:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945591.086752:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273653888:0@lo:400:kworker.0 00000100:00100000:0.0:1790945591.086779:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945591.086798:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273654400:0@lo:400:kworker.0 00000100:00100000:0.0:1790945591.086824:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945591.086844:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945591.086849:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273654016:0@lo:400:kworker.0 00000100:00100000:0.0:1790945591.086871:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945591.086955:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273654272 00000100:00100000:1.0:1790945591.086966:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273654272 00000100:00100000:0.0:1790945591.087000:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273654144 00000100:00100000:0.0:1790945591.087005:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273654144 00000100:00100000:1.0:1790945591.087025:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273653888 00000100:00100000:1.0:1790945591.087028:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273653888 00000100:00100000:0.0:1790945591.087031:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273654400 00000100:00100000:0.0:1790945591.087033:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273654400 00000100:00100000:1.0:1790945591.087040:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273654016 00000100:00100000:1.0:1790945591.087043:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273654016 00000100:00100000:1.0:1790945591.087055:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790945591.087055:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790945591.087064:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273654144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945591.087065:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273654272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945591.087127:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273654272:12345-0@lo:400:kworker.0 Request processed in 63us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945591.087127:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273654144:12345-0@lo:400:kworker.0 Request processed in 63us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945591.087135:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790945591.087135:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790945591.087153:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790945591.087153:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790945591.087160:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273653888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945591.087160:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273654400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945591.087190:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273653888:12345-0@lo:400:kworker.0 Request processed in 31us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945591.087190:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273654400:12345-0@lo:400:kworker.0 Request processed in 30us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945591.087196:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790945591.087197:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790945591.087207:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790945591.087214:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273654016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945591.087241:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273654016:12345-0@lo:400:kworker.0 Request processed in 29us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945591.087247:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790945591.087274:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273653760 00000100:00100000:1.0:1790945591.087278:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273653760 00000100:00100000:1.0:1790945591.087860:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1790945591.087937:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273653760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945591.087987:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273653760:12345-0@lo:400:kworker.0 Request processed in 118us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945591.088004:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1790945591.088100:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273654016:0@lo:400:kworker.0 00000100:00100000:1.0:1790945591.088114:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273653888:0@lo:400:kworker.0 00000100:00100000:1.0:1790945591.088124:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273654400:0@lo:400:kworker.0 00000100:00100000:1.0:1790945591.088160:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273654144:0@lo:400:kworker.0 00000100:00100000:1.0:1790945591.088169:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273654272:0@lo:400:kworker.0 00000100:00100000:1.0:1790945591.088179:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88183aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273653760:0@lo:400:kworker.0 00000100:00080000:2.0:1790945591.098288:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945591.098302:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790945591.098307:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945591.580148:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273654528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945591.580314:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945591.580423:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273654528 00000100:00100000:2.0:1790945591.580433:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273654528 00000100:00100000:2.0:1790945591.580489:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790945591.580499:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273654528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945591.580555:0:6675:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945591.580722:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88179d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273654656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945591.587173:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945591.587701:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1790945591.587713:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1790945591.588504:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273654656 00000100:00100000:0.0:1790945591.588517:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273654656 00000100:00100000:0.0:1790945591.588686:0:12725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790945591.588699:0:12725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88179c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273654656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790945591.588745:0:12725:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945591.590262:0:12725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88179c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273654656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1559us (3093us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945591.590274:0:12725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790945591.590605:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88179d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273654656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945591.591172:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273654528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10671us (10856us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945591.591183:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790945591.591314:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273654528:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790945592.032894:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945592.980516:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945592.980555:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945592.980597:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945592.980619:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945592.980714:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945592.980747:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254799360 00000100:00100000:2.0:1790945592.980759:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254799360 00000100:00100000:2.0:1790945592.980826:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254799232 00000100:00100000:2.0:1790945592.980830:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254799232 00000100:00100000:2.0:1790945592.980854:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 96 00000100:00100000:2.0:1790945592.980877:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2372:x1877942254799360:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945592.980974:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2372:x1877942254799360:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 110us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945592.980984:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 96 00000100:00100000:2.0:1790945592.981002:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 97 00000100:00100000:2.0:1790945592.981008:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2372:x1877942254799232:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945592.981030:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2372:x1877942254799232:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 23us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945592.981037:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 97 00000100:00100000:2.0:1790945592.981054:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254799104 00000100:00100000:2.0:1790945592.981056:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254799104 00000100:00100000:2.0:1790945592.981083:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254799488 00000100:00100000:2.0:1790945592.981086:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254799488 00000100:00100000:2.0:1790945592.981103:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 161 00000100:00100000:2.0:1790945592.981109:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:2372:x1877942254799104:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945592.981140:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:2372:x1877942254799104:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 32us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945592.981147:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 161 00000100:00100000:2.0:1790945592.981157:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 162 00000100:00100000:2.0:1790945592.981163:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86543a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2372:x1877942254799488:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945592.981193:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86543a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2372:x1877942254799488:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 30us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945592.981199:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 162 00000100:00080000:2.0:1790945592.981217:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790945592.981222:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790945592.981224:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790945592.981730:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254798976 00000100:00100000:3.0:1790945592.981738:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254798976 00000100:00100000:3.0:1790945592.981778:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 300 00000100:00100000:3.0:1790945592.981794:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2372:x1877942254798976:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945592.981837:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+13:2372:x1877942254798976:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 44us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945592.981843:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 300 00010000:00010000:1.0:1790945593.051932:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945593.960259:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945593.960326:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254799616 00000100:00100000:1.0:1790945593.960336:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254799616 00000100:00100000:1.0:1790945593.960437:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 238 00000100:00100000:1.0:1790945593.960445:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+5:12287:x1877942254799616:12345-192.168.202.48@tcp:101:lsof.0 00010000:00010000:1.0:1790945593.960464:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945593.960480:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a5501a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c84da expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945593.960569:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5501ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945593.960580:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5501ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945593.960590:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5501ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945593.960637:0:5824:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790945593.960640:0:5824:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790945593.961749:0:5824:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5501ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945593.961895:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133800/0xc5cf2c2a6a5501a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84da expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945593.961916:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5501ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84da expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945593.961925:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb85a4d2d00) 00010000:00010000:0.0:1790945593.961928:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945593.961932:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132400, rc 0) 00000100:00100000:0.0:1790945593.962012:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:532c7531-c10c-43ae-8cad-28d7c162ca26+6:12287:x1877942254799616:12345-192.168.202.48@tcp:101:lsof.0 Request processed in 1566us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945593.962022:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 238 00010000:00010000:1.0:1790945594.079121:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945595.099885:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945596.125172:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945596.189420:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88179d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273655040:0@lo:400:kworker.0 00000100:00100000:0.0:1790945596.189505:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945596.189580:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790945596.189587:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88179df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273654912:0@lo:400:kworker.0 00000100:00100000:0.0:1790945596.189612:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945596.189638:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273655424:0@lo:400:kworker.0 00000100:00100000:0.0:1790945596.189693:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945596.189822:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb88179dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273654784:0@lo:400:kworker.0 00000100:00100000:1.0:1790945596.189859:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945596.189892:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273655296:0@lo:400:kworker.0 00000100:00100000:1.0:1790945596.189915:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945596.189932:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945596.189937:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273655168:0@lo:400:kworker.0 00000100:00100000:1.0:1790945596.189959:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945596.189987:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273655040 00000100:00100000:1.0:1790945596.189994:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273655040 00000100:00100000:1.0:1790945596.190040:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273654912 00000100:00100000:1.0:1790945596.190044:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273654912 00000100:00100000:1.0:1790945596.190055:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273655296 00000100:00100000:1.0:1790945596.190057:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273655296 00000100:00100000:1.0:1790945596.190070:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790945596.190078:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273655040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945596.190130:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273655040:12345-0@lo:400:kworker.0 Request processed in 52us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945596.190137:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790945596.190152:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790945596.190157:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273654912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945596.190183:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273654912:12345-0@lo:400:kworker.0 Request processed in 26us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945596.190196:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790945596.190206:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790945596.190212:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273655296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945596.190241:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273655296:12345-0@lo:400:kworker.0 Request processed in 30us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945596.190247:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790945596.190287:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273655296:0@lo:400:kworker.0 00000100:00100000:1.0:1790945596.190315:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88179df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273654912:0@lo:400:kworker.0 00000100:00100000:1.0:1790945596.190324:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88179d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273655040:0@lo:400:kworker.0 00000100:00100000:2.0:1790945596.190725:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273655424 00000100:00100000:2.0:1790945596.190731:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273655424 00000100:00100000:2.0:1790945596.190771:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273655168 00000100:00100000:2.0:1790945596.190774:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273655168 00000100:00100000:2.0:1790945596.190801:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790945596.190810:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273655424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945596.190858:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273655424:12345-0@lo:400:kworker.0 Request processed in 49us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945596.190865:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790945596.190878:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790945596.190884:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273655168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945596.190917:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273655168:12345-0@lo:400:kworker.0 Request processed in 33us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945596.190923:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1790945596.190942:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790945596.190947:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790945596.190949:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945596.190971:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273655168:0@lo:400:kworker.0 00000100:00100000:2.0:1790945596.190992:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273655424:0@lo:400:kworker.0 00000100:00100000:0.0:1790945596.191109:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273654784 00000100:00100000:0.0:1790945596.191113:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273654784 00000100:00100000:0.0:1790945596.191150:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1790945596.191160:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273654784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945596.191206:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3295:x1877942273654784:12345-0@lo:400:kworker.0 Request processed in 48us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945596.191213:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1790945596.191469:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb88179dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273654784:0@lo:400:kworker.0 00000100:00100000:2.0:1790945596.376931:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945596.377415:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254799872 00000100:00100000:0.0:1790945596.377427:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254799872 00000100:00100000:0.0:1790945596.377515:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:0.0:1790945596.377525:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+19:12289:x1877942254799872:12345-192.168.202.48@tcp:35:umount.0 00000100:00100000:0.0:1790945596.377947:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:12289:x1877942254799872:12345-192.168.202.48@tcp:35:umount.0 Request processed in 423us (1026us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1790945596.377955:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00080000:2.0:1790945596.378024:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945596.392285:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945596.394494:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254800128 00000100:00100000:1.0:1790945596.394509:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254800128 00000100:00100000:1.0:1790945596.394579:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 67 00000100:00100000:1.0:1790945596.394589:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86543a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+20:12289:x1877942254800128:12345-192.168.202.48@tcp:35:umount.0 00000100:00100000:1.0:1790945596.394984:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86543a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:12289:x1877942254800128:12345-192.168.202.48@tcp:35:umount.0 Request processed in 396us (2708us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1790945596.394993:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 67 00000100:00100000:3.0:1790945596.410288:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945596.410963:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254800384 00000100:00100000:1.0:1790945596.410974:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254800384 00000100:00100000:1.0:1790945596.411039:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:1.0:1790945596.411049:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8477f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+21:12289:x1877942254800384:12345-192.168.202.48@tcp:35:umount.0 00000100:00100000:1.0:1790945596.411306:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8477f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:12289:x1877942254800384:12345-192.168.202.48@tcp:35:umount.0 Request processed in 258us (1026us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1790945596.411314:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:2.0:1790945596.416545:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945596.416744:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254800640 00000100:00100000:1.0:1790945596.416754:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254800640 00000100:00100000:1.0:1790945596.416806:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:1.0:1790945596.416815:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+22:12289:x1877942254800640:12345-192.168.202.48@tcp:35:umount.0 00000100:00100000:1.0:1790945596.417134:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:12289:x1877942254800640:12345-192.168.202.48@tcp:35:umount.0 Request processed in 319us (599us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1790945596.417142:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:3.0:1790945596.423050:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945596.423136:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254800768 00000100:00100000:1.0:1790945596.423147:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254800768 00000100:00100000:1.0:1790945596.423215:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 18 00000100:00100000:1.0:1790945596.423225:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee3b157-ad31-4030-99ec-031c727e7689+13:2372:x1877942254800768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945596.423242:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945596.423272:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167bc00/0xc5cf2c2a6a54f234 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c806c expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945596.423289:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945596.423357:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bee3b157-ad31-4030-99ec-031c727e7689+12:2372:x1877942254800768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 132us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945596.423365:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 18 00000100:00100000:3.0:1790945596.428590:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945596.428643:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945596.430131:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254800896 00000100:00100000:0.0:1790945596.430144:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254800896 00000100:00100000:0.0:1790945596.430265:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254801024 00000100:00100000:0.0:1790945596.430269:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254801024 00000100:00100000:1.0:1790945596.430329:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 19 00000100:00100000:1.0:1790945596.430342:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee3b157-ad31-4030-99ec-031c727e7689+13:2373:x1877942254800896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945596.430360:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945596.430382:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb840030a00/0xc5cf2c2a6a54f19a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8034 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945596.430399:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945596.430490:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee3b157-ad31-4030-99ec-031c727e7689+12:2373:x1877942254800896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 151us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945596.430499:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 19 00000100:00100000:1.0:1790945596.430521:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 20 00000100:00100000:1.0:1790945596.430528:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee3b157-ad31-4030-99ec-031c727e7689+11:2373:x1877942254801024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790945596.430535:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790945596.430545:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8434af800/0xc5cf2c2a6a54f448 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8137 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945596.430553:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945596.430572:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bee3b157-ad31-4030-99ec-031c727e7689+10:2373:x1877942254801024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 46us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945596.430579:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 20 00000100:00100000:3.0:1790945596.432931:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945596.433403:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254801408 00000100:00100000:2.0:1790945596.433414:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254801408 00000100:00100000:2.0:1790945596.433471:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 72 00000100:00100000:2.0:1790945596.433493:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2369:x1877942254801408:12345-192.168.202.48@tcp:9:umount.0 00000020:00000080:2.0:1790945596.433524:0:6672:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f774 00000020:00010000:2.0:1790945596.433532:0:6672:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bb86023a800: total 0 00000100:00080000:2.0:1790945596.433538:0:6672:0:(import.c:65:import_set_state_nolock()) ffff9bb846041000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790945596.433582:0:6672:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1790945596.434472:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2369:x1877942254801408:12345-192.168.202.48@tcp:9:umount.0 Request processed in 979us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945596.434547:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 72 00000020:00010000:2.0:1790945596.434593:0:5812:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bb86023a800: total 0 00010000:00010000:2.0:1790945596.434616:0:5812:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bb86023a800, canceled 0 locks, left on hash table 2. 00000100:00080000:3.0:1790945596.434939:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790945596.439473:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5501a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84d3 expref: 4 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945596.439557:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f82de5d/0xc5cf2c2a6a54fb10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c830c expref: 3 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945596.439573:0:5812:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bb86023a800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1790945596.439603:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945596.439605:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945596.439607:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945596.440612:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945596.441064:0:7919:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254801536 00000100:00100000:3.0:1790945596.441074:0:7919:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254801536 00000100:00100000:3.0:1790945596.441175:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 73 00000100:00100000:3.0:1790945596.441186:0:7919:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86543b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+5:2369:x1877942254801536:12345-192.168.202.48@tcp:9:umount.0 00000020:00000080:3.0:1790945596.441216:0:7919:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f50c 00000100:00080000:3.0:1790945596.441235:0:7919:0:(import.c:65:import_set_state_nolock()) ffff9bb87b4bd800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790945596.441276:0:7919:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1790945596.441563:0:7919:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86543b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+2:2369:x1877942254801536:12345-192.168.202.48@tcp:9:umount.0 Request processed in 378us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945596.441571:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 73 00010000:00010000:0.0:1790945596.444645:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790945596.449506:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945596.471119:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945596.471236:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254802560 00000100:00100000:1.0:1790945596.471248:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254802560 00000100:00100000:1.0:1790945596.471315:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 239 00000100:00100000:1.0:1790945596.471326:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+23:2369:x1877942254802560:12345-192.168.202.48@tcp:39:umount.0 00000020:00000080:1.0:1790945596.471360:0:5825:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f1a8 00000020:00010000:1.0:1790945596.471378:0:5825:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bb87fbcd000: total 0 00000100:00080000:1.0:1790945596.471384:0:5825:0:(import.c:65:import_set_state_nolock()) ffff9bb865e74000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790945596.471425:0:5825:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1790945596.471937:0:5812:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bb87fbcd000: total 0 00010000:00010000:3.0:1790945596.471943:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945596.471982:0:5812:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bb87fbcd000, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1790945596.472017:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:3.0:1790945596.472021:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945596.472045:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431c00/0xc5cf2c2a6a550081 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8486 expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472069:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:3.0:1790945596.472072:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790945596.472076:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030400/0xc5cf2c2a6a54fb80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8328 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472091:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:3.0:1790945596.472093:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790945596.472097:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b133200/0xc5cf2c2a6a54fac3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82f7 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472109:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:3.0:1790945596.472112:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790945596.472116:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d800/0xc5cf2c2a6a54fafb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8305 expref: 20 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472129:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:3.0:1790945596.472131:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790945596.472135:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae600/0xc5cf2c2a6a54f7cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8233 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472148:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bb851c9ab00) 00010000:00010000:3.0:1790945596.472150:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945596.472154:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5800/0xc5cf2c2a6a54f472 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8145 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472175:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:3.0:1790945596.472184:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790945596.472189:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840030600/0xc5cf2c2a6a54f9f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82bf expref: 17 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472204:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bb85a4d2700) 00010000:00010000:3.0:1790945596.472206:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945596.472209:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434ae000/0xc5cf2c2a6a54faed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c82fe expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472238:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:3.0:1790945596.472241:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945596.472245:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031600/0xc5cf2c2a6a550161 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84be expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472259:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bb8510c8a00) 00010000:00010000:3.0:1790945596.472261:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790945596.472264:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a54f4e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8161 expref: 14 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472278:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb85a4d2d00) 00010000:00010000:3.0:1790945596.472281:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945596.472285:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb840031400/0xc5cf2c2a6a54fb64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8321 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472297:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bb845042900) 00010000:00010000:3.0:1790945596.472299:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790945596.472302:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c200/0xc5cf2c2a6a55018b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84cc expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472331:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a900) 00010000:00010000:3.0:1790945596.472334:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945596.472338:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8821c5000/0xc5cf2c2a6a54f48e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c814c expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472353:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bb85a4d2a00) 00010000:00010000:3.0:1790945596.472355:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790945596.472359:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb8434afa00/0xc5cf2c2a6a54fe5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c83fa expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945596.472372:0:5812:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bb87fbcd000, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1790945596.472385:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945596.472387:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945596.472389:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945596.473264:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6be5708-366a-4e39-b76f-5dba2d1f1a3b+7:2369:x1877942254802560:12345-192.168.202.48@tcp:39:umount.0 Request processed in 1935us (2150us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1790945596.473274:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 239 00000100:00100000:2.0:1790945596.705565:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945596.705587:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86543aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273655552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790945596.705696:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945596.705770:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945596.705780:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273655680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945596.705809:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945596.706428:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273655552 00000100:00100000:0.0:1790945596.706437:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273655552 00000100:00100000:0.0:1790945596.706496:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273655680 00000100:00100000:0.0:1790945596.706500:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273655680 00000100:00100000:0.0:1790945596.706529:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790945596.706538:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86543b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273655552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945596.706571:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945596.706635:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86543b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273655552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945596.706643:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790945596.706716:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790945596.706723:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273655680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790945596.706738:0:6674:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945596.706770:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273655680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945596.706777:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790945596.707089:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86543aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273655552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945596.707578:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273655680:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1790945596.763695:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000020:00000080:0.0:1790945596.763711:0:6695:0:(genops.c:885:class_export_put()) final put ffff9bb860238800/c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000020:00000080:1.0:1790945596.763980:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb860238800/c6be5708-366a-4e39-b76f-5dba2d1f1a3b for lustre-OST0000 00000020:00000080:1.0:1790945596.764030:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb87b4bd800 for lustre-OST0000 00010000:00010000:0.0:1790945597.148149:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945598.099618:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945598.099726:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945598.100218:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254802688 00000100:00100000:1.0:1790945598.100242:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254802688 00000100:00100000:1.0:1790945598.100293:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 302 00000100:00100000:1.0:1790945598.100304:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:2370:x1877942254802688:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945598.100382:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bee3b157-ad31-4030-99ec-031c727e7689+10:2370:x1877942254802688:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 80us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945598.100390:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 302 00000100:00100000:2.0:1790945598.101453:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254802816 00000100:00100000:2.0:1790945598.101474:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254802816 00000100:00100000:2.0:1790945598.101544:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 166 00000100:00100000:2.0:1790945598.101554:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+6:2370:x1877942254802816:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945598.101629:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:532c7531-c10c-43ae-8cad-28d7c162ca26+6:2370:x1877942254802816:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 77us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945598.101637:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 166 00000100:00080000:3.0:1790945598.102392:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790945598.173321:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790945598.783144:0:7627:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000020:00000080:0.0:1790945598.783152:0:7627:0:(genops.c:885:class_export_put()) final put ffff9bb86023a800/c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000020:00000080:3.0:1790945598.783413:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb86023a800/c6be5708-366a-4e39-b76f-5dba2d1f1a3b for lustre-OST0001 00000020:00000080:3.0:1790945598.783474:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb846041000 for lustre-OST0001 00000001:00080000:3.0:1790945598.787933:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00100000:3.0:1790945598.788030:0:5846:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000001:00080000:3.0:1790945598.788041:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1790945598.788126:0:5846:0:(genops.c:885:class_export_put()) final put ffff9bb87fbcd000/c6be5708-366a-4e39-b76f-5dba2d1f1a3b 00000020:00000080:2.0:1790945598.788201:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87fbcd000/c6be5708-366a-4e39-b76f-5dba2d1f1a3b for lustre-MDT0000 00000020:00000080:2.0:1790945598.788326:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb865e74000 for lustre-MDT0000 00000100:00100000:3.0:1790945598.916535:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945598.916575:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945598.916640:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945598.916762:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254802944 00000100:00100000:0.0:1790945598.916773:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254802944 00000100:00100000:0.0:1790945598.916837:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254803072 00000100:00100000:0.0:1790945598.916840:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254803072 00000100:00100000:0.0:1790945598.916852:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254803200 00000100:00100000:0.0:1790945598.916854:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254803200 00000100:00100000:0.0:1790945598.916868:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 21 00000100:00100000:0.0:1790945598.916877:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee3b157-ad31-4030-99ec-031c727e7689+12:2370:x1877942254802944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945598.916893:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945598.916911:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8434afc00/0xc5cf2c2a6a54f27a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8081 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945598.916942:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945598.916994:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee3b157-ad31-4030-99ec-031c727e7689+11:2370:x1877942254802944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 117us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945598.917002:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 21 00000100:00100000:0.0:1790945598.917043:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 22 00000100:00100000:0.0:1790945598.917049:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee3b157-ad31-4030-99ec-031c727e7689+10:2370:x1877942254803072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945598.917057:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945598.917076:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167b600/0xc5cf2c2a6a54f281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c80ab expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945598.917086:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945598.917102:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee3b157-ad31-4030-99ec-031c727e7689+9:2370:x1877942254803072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 54us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945598.917109:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 22 00000100:00100000:0.0:1790945598.917120:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 23 00000100:00100000:0.0:1790945598.917126:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee3b157-ad31-4030-99ec-031c727e7689+8:2370:x1877942254803200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945598.917133:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945598.917141:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865d1c800/0xc5cf2c2a6a54f441 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8130 expref: 8 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945598.917149:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945598.917163:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bee3b157-ad31-4030-99ec-031c727e7689+7:2370:x1877942254803200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 37us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945598.917169:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 23 00000100:00100000:1.0:1790945598.930011:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945598.930153:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254803456 00000100:00100000:2.0:1790945598.930162:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254803456 00000100:00100000:2.0:1790945598.930218:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 240 00000100:00100000:2.0:1790945598.930228:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+6:2369:x1877942254803456:12345-192.168.202.48@tcp:39:umount.0 00000020:00000080:2.0:1790945598.930269:0:7211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f28f 00000020:00010000:2.0:1790945598.930277:0:7211:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bb865edb800: total 0 00000100:00080000:2.0:1790945598.930282:0:7211:0:(import.c:65:import_set_state_nolock()) ffff9bb865eda800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790945598.930309:0:7211:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1790945598.930783:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:532c7531-c10c-43ae-8cad-28d7c162ca26+5:2369:x1877942254803456:12345-192.168.202.48@tcp:39:umount.0 Request processed in 554us (780us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1790945598.930808:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 240 00000020:00010000:0.0:1790945598.931858:0:5811:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bb865edb800: total 0 00010000:00010000:0.0:1790945598.931910:0:5811:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bb865edb800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790945598.931943:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb85a4d2d00) 00010000:00010000:0.0:1790945598.931947:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790945598.931956:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb87b132400/0xc5cf2c2a6a5501ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84da expref: 4 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945598.931979:0:5811:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bb865edb800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1790945598.931988:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945598.931990:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945598.931992:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790945598.940474:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790945598.940483:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790945598.941071:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1790945598.941078:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790945598.955495:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945598.955597:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254803712 00000100:00100000:3.0:1790945598.955609:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254803712 00000100:00100000:3.0:1790945598.955712:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 303 00000100:00100000:3.0:1790945598.955723:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+7:2369:x1877942254803712:12345-192.168.202.48@tcp:251:umount.0 00000020:00000080:3.0:1790945598.955771:0:5818:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f185 00000020:00010000:3.0:1790945598.955778:0:5818:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bb865e75000: total 0 00000100:00080000:3.0:1790945598.955783:0:5818:0:(import.c:65:import_set_state_nolock()) ffff9bb865e73800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790945598.956136:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bee3b157-ad31-4030-99ec-031c727e7689+3:2369:x1877942254803712:12345-192.168.202.48@tcp:251:umount.0 Request processed in 413us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945598.956145:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 303 00000020:00010000:2.0:1790945598.961332:0:5812:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bb865e75000: total 0 00010000:00010000:2.0:1790945598.961343:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945598.961396:0:5812:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bb865e75000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790945598.961443:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865d1d000/0xc5cf2c2a6a54f23b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8073 expref: 2 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945598.961495:0:5812:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bb865e75000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1790945598.961505:0:5812:0:(genops.c:885:class_export_put()) final put ffff9bb865e75000/bee3b157-ad31-4030-99ec-031c727e7689 00010000:00010000:2.0:1790945598.961527:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945598.961529:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945598.961532:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790945598.961639:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb865e75000/bee3b157-ad31-4030-99ec-031c727e7689 for MGS 00000020:00000080:1.0:1790945598.961713:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb865e73800 for MGS 00010000:00010000:0.0:1790945599.196159:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945600.229810:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790945601.223786:0:12896:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790945601.248210:0:12896:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1790945601.248262:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945601.248277:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945601.248285:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945601.248293:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945601.248308:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790945601.248313:0:12896:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790945601.248334:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790945601.248338:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790945601.248344:0:12896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790945601.248369:0:12896:0:(import.c:65:import_set_state_nolock()) ffff9bb850e93000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1790945601.248704:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945601.248712:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.248720:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af000 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1790945601.248725:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.248734:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945601.248742:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945601.248760:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790945601.248763:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790945601.248766:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790945601.248793:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.248800:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790945601.248826:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.248832:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8434af000/0xc5cf2c2a6a54f20a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f211 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.248844:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945601.248846:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945601.248848:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945601.248855:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790945601.248875:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273655936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945601.248955:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945601.249016:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273655936 00000100:00100000:0.0:1790945601.249024:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273655936 00000100:00100000:0.0:1790945601.249079:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790945601.249089:0:5810:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3294:x1877942273655936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790945601.249103:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945601.249117:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a7c00/0xc5cf2c2a6a54f211 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f20a expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.249130:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945601.249174:0:5810:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:3294:x1877942273655936:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945601.249182:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790945601.249217:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273655936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945601.251151:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1877942273655808:0@lo:39:umount.0 00000100:00100000:2.0:1790945601.251264:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945601.254883:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273655808 00000100:00100000:0.0:1790945601.254899:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273655808 00000100:00100000:1.0:1790945601.256850:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790945601.256865:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86543a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1877942273655808:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790945601.256900:0:5823:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54ef94 00000100:00080000:1.0:1790945601.256909:0:5823:0:(import.c:65:import_set_state_nolock()) ffff9bb87b46d000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790945601.257024:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86543a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3291:x1877942273655808:12345-0@lo:39:umount.0 Request processed in 162us (5760us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945601.257031:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1790945601.257042:0:5823:0:(genops.c:885:class_export_put()) final put ffff9bb87b46b800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1790945601.258197:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790945601.258209:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87b46b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790945601.258267:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb87b46d000 for lustre-MDT0000 00000100:00080000:2.0:1790945601.258319:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb850e93000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790945601.258333:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1877942273655808:0@lo:39:umount.0 00010000:00010000:2.0:1790945601.258496:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790945601.258547:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790945601.258552:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790945601.258557:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790945601.260193:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.260210:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.260217:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.260224:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.260296:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790945601.260303:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.260310:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.260316:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.260332:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.260362:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790945601.260369:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.260376:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8414a6800 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945601.260380:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.260394:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945601.260401:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945601.260406:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790945601.260409:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1790945601.260453:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.260460:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945601.260497:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.260504:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6800/0xc5cf2c2a6a54f218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f21f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.260520:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945601.260523:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.260528:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8414a6a00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945601.260530:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.260537:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945601.260542:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945601.260554:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1790945601.260556:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1790945601.260569:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.260576:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945601.260582:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.260589:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945601.260591:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945601.260593:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945601.260879:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273656064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945601.261257:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945601.261318:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790945601.261325:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86543aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273656192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945601.261348:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945601.261382:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273656064 00000100:00100000:3.0:1790945601.261389:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273656064 00000100:00100000:3.0:1790945601.261449:0:5808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273656192 00000100:00100000:3.0:1790945601.261452:0:5808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273656192 00000100:00100000:3.0:1790945601.261477:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790945601.261485:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+19:3292:x1877942273656064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790945601.261500:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945601.261515:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c5200/0xc5cf2c2a6a54f21f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f218 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945601.261539:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945601.261575:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+18:3292:x1877942273656064:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945601.261583:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790945601.261603:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790945601.262113:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:3292:x1877942273656192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790945601.262124:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945601.262134:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a7800/0xc5cf2c2a6a54f146 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f13f expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945601.262149:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945601.262178:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:3292:x1877942273656192:12345-0@lo:103:ldlm_bl.0 Request processed in 569us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945601.262185:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790945601.262228:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86543aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273656192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945601.262237:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273656064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790945601.262494:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790945601.262503:0:12896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8414a6a00/0xc5cf2c2a6a54f13f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f146 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945601.262520:0:12896:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790945601.262530:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.262537:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.262545:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.262553:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.262628:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945601.262634:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.262641:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132e00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945601.262645:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.262653:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945601.262688:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945601.262809:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790945601.262812:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1790945601.262837:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.262859:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790945601.262916:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1790945601.263039:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.263050:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945601.263051:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945601.263053:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945601.263159:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790945601.263165:0:12896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb87b132e00/0xc5cf2c2a6a54f433 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f43a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945601.263176:0:12896:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790945601.263215:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb840031a00/0xc5cf2c2a6a54eef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.263224:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb840031a00/0xc5cf2c2a6a54eef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.263239:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb840031a00/0xc5cf2c2a6a54eef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.263245:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff9bb840031a00/0xc5cf2c2a6a54eef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945601.263264:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790945601.263268:0:12896:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1790945601.263271:0:12896:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1790945601.263297:0:12896:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1790945601.263302:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1790945601.263307:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790945601.263313:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1790945601.263319:0:12896:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9bb8818f6800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790945601.263325:0:12896:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9bb87fbce800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790945601.263331:0:12896:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9bb865edb800 532c7531-c10c-43ae-8cad-28d7c162ca26 192.168.202.48@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790945601.263336:0:12896:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9bb842ec0000) has exports, disconnecting them 00000020:00080000:0.0:1790945601.263340:0:12896:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bb8818f6800), last request at 1790945596 00000020:00000080:0.0:1790945601.263347:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f107 00000100:00080000:0.0:1790945601.263364:0:12896:0:(import.c:65:import_set_state_nolock()) ffff9bb8818f1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790945601.263407:0:12896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bb8818f6800): rc 0 00000020:00000080:0.0:1790945601.263410:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb8818f6800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1790945601.263419:0:12896:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bb87fbce800), last request at 1790945596 00000020:00000080:0.0:1790945601.263423:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f03c 00000100:00080000:0.0:1790945601.263440:0:12896:0:(import.c:65:import_set_state_nolock()) ffff9bb87fbc9000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790945601.263449:0:12896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bb87fbce800): rc 0 00000020:00000080:0.0:1790945601.263451:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb87fbce800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1790945601.263465:0:12896:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb6b44160fae0 00000100:00080000:0.0:1790945601.263486:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790945601.263490:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1790945601.263503:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790945601.263565:0:12896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1790945601.263578:0:12896:0:(import.c:65:import_set_state_nolock()) ffff9bb87b251000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1790945601.263588:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790945601.263590:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1790945601.263597:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1790945601.263836:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945601.263842:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb840031a00/0xc5cf2c2a6a54eef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.263849:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb840031a00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945601.263852:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb840031a00/0xc5cf2c2a6a54eef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.263859:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb840031a00/0xc5cf2c2a6a54eef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945601.263866:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb840031a00/0xc5cf2c2a6a54eef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945601.263872:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1790945601.263874:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1790945601.263876:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1790945601.263895:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb840031a00/0xc5cf2c2a6a54eef3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.263902:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1790945601.264017:0:12896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1790945601.264028:0:12896:0:(import.c:65:import_set_state_nolock()) ffff9bb865e70000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1790945601.264080:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9bb842ec0000) has no exports 00000020:00000080:3.0:1790945601.264393:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb8818f6800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790945601.264447:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87fbce800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790945601.264470:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb8818f1000 for lustre-MDT0000 00000020:00000080:3.0:1790945601.264474:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb87fbc9000 for lustre-MDT0000 00010000:00010000:3.0:1790945601.264484:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945601.264630:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86543aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273656576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945601.264724:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945601.264773:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273656320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945601.264796:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945601.264875:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273656576 00000100:00100000:3.0:1790945601.264882:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273656576 00000100:00100000:3.0:1790945601.264935:0:5809:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273656320 00000100:00100000:3.0:1790945601.264938:0:5809:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273656320 00000100:00100000:3.0:1790945601.264962:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945601.264982:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b378000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+17:3295:x1877942273656576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790945601.264996:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945601.265010:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c4c00/0xc5cf2c2a6a54eefa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54eef3 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945601.265025:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945601.265063:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b378000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+16:3295:x1877942273656576:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945601.265070:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945601.265085:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790945601.265091:0:5809:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865db6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+15:3295:x1877942273656320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790945601.265098:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945601.265106:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb87b132600/0xc5cf2c2a6a54f43a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f433 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945601.265115:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945601.265135:0:5809:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865db6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:3295:x1877942273656320:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945601.265141:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790945601.265188:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86543aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273656576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945601.265196:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273656320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945601.265749:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb840031a00/0xc5cf2c2a6a54eef3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.265771:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb840031a00/0xc5cf2c2a6a54eef3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54eefa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945601.265788:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945601.265789:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945601.265791:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945601.265823:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273656448:0@lo:9:umount.0 00000100:00100000:2.0:1790945601.265860:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945601.265938:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273656704:0@lo:9:umount.0 00000100:00100000:2.0:1790945601.265962:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945601.266290:0:6672:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273656448 00000100:00100000:3.0:1790945601.266296:0:6672:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273656448 00000100:00100000:1.0:1790945601.266335:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273656704 00000100:00100000:1.0:1790945601.266339:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273656704 00000100:00100000:1.0:1790945601.266473:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790945601.266483:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86543aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1877942273656704:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790945601.266508:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f170 00000100:00080000:1.0:1790945601.266516:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9bb87b4bd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790945601.266558:0:6673:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1790945601.267116:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86543aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3291:x1877942273656704:12345-0@lo:9:umount.0 Request processed in 633us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945601.267125:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1790945601.267334:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790945601.267937:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790945601.267973:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb865e70000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790945601.267992:0:3291:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790945601.267995:0:3291:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790945601.267999:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273656704:0@lo:9:umount.0 00000100:00100000:0.0:1790945601.268336:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790945601.268346:0:6672:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1877942273656448:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790945601.268371:0:6672:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f089 00000100:00080000:0.0:1790945601.268379:0:6672:0:(import.c:65:import_set_state_nolock()) ffff9bb87b252000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790945601.268412:0:6672:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1790945601.269229:0:6672:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865439180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3291:x1877942273656448:12345-0@lo:9:umount.0 Request processed in 542us (3025us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945601.269241:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1790945601.269262:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790945601.269319:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb87b251000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790945601.269336:0:3291:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790945601.269338:0:3291:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790945601.269342:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273656448:0@lo:9:umount.0 00000100:00080000:3.0:1790945601.269414:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1790945601.273283:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9bb842ec0000) has no exports 00000100:00100000:3.0:1790945601.308034:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273656832:0@lo:400:kworker.0 00000100:00100000:0.0:1790945601.308034:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273656960:0@lo:400:kworker.0 00000100:00100000:0.0:1790945601.310937:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945601.311060:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273656960 00000100:00100000:2.0:1790945601.311071:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273656960 00000100:00100000:2.0:1790945601.311131:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1790945601.311140:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3293:x1877942273656960:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790945601.311150:0:7211:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790945601.311202:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3293:x1877942273656960:12345-0@lo:400:kworker.0 Request processed in 61us (273us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790945601.311209:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:0.0:1790945601.311304:0:3293:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790945601.311310:0:3293:0:(import.c:65:import_set_state_nolock()) ffff9bb87fb61000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790945601.311314:0:3293:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1790945601.314467:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945601.314735:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273656832 00000100:00100000:2.0:1790945601.314748:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273656832 00000100:00100000:2.0:1790945601.316943:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1790945601.316955:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3292:x1877942273656832:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790945601.316966:0:5824:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790945601.317064:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3292:x1877942273656832:12345-0@lo:400:kworker.0 Request processed in 109us (2607us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790945601.317072:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1790945601.317089:0:3292:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790945601.317100:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9bb87fbcf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790945601.317105:0:3292:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790945601.317111:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9bb87fbcf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790945601.317115:0:3292:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 144 00000100:00080000:3.0:1790945601.317129:0:3292:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bb87fbcf000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1790945601.317166:0:3292:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87fe03800 x1877942273657088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790945601.317198:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273656832:0@lo:400:kworker.0 00000100:00100000:2.0:1790945601.317730:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1877942273657088:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1790945601.317786:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945601.317838:0:7211:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273657088 00000100:00100000:3.0:1790945601.317847:0:7211:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273657088 00000100:00100000:3.0:1790945601.317889:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790945601.317895:0:7211:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3291:x1877942273657088:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1790945601.317915:0:7211:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000020:00000080:1.0:1790945601.324866:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54ef4e 00000020:00000080:1.0:1790945601.324882:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb842f1e800/lustre-QMT0000_UUID 00000020:01000000:1.0:1790945601.324945:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000100:00080000:0.0:1790945601.326091:0:3293:0:(import.c:65:import_set_state_nolock()) ffff9bb87fb61000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790945601.326109:0:3293:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 166 00000100:00080000:0.0:1790945601.326122:0:3293:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bb87fb61000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1790945601.326156:0:3293:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87b374e00 x1877942273657216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790945601.326183:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273656960:0@lo:400:kworker.0 00000100:00100000:1.0:1790945601.326326:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1877942273657216:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1790945601.326392:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945601.326497:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273657216 00000100:00100000:0.0:1790945601.326506:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273657216 00000100:00100000:0.0:1790945601.326589:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1790945601.326596:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1877942273657216:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1790945601.326624:0:5823:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790945601.326696:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1877942273657216:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 98us (303us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790945601.326703:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000020:00000080:2.0:1790945601.326910:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb842f1e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1790945601.326952:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790945601.326960:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790945601.326964:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9bb86560cd40) has no exports 00000020:00000080:2.0:1790945601.327157:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54ef47 00000020:00000080:2.0:1790945601.327164:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb874a96800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790945601.327176:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb874a96800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790945601.327216:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790945601.327223:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790945601.327225:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb874a92800/lustre-QMT0000_UUID 00000020:00000080:2.0:1790945601.327227:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb874a92800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1790945601.327232:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00080000:0.0:1790945601.334149:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb87fb61000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790945601.334160:0:3291:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790945601.334164:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1877942273657216:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1790945601.335363:0:7211:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3291:x1877942273657088:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 17463us (17573us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790945601.335375:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1790945601.335478:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb87fbcf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790945601.335484:0:3291:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790945601.335488:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1877942273657088:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:1.0:1790945601.920533:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790945601.920542:0:6695:0:(genops.c:885:class_export_put()) final put ffff9bb87b252800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790945601.920792:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87b252800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1790945601.920842:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb87b252000 for lustre-OST0000 00010000:00010000:2.0:1790945602.267912:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945603.296095:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790945603.919184:0:7627:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790945603.919194:0:7627:0:(genops.c:885:class_export_put()) final put ffff9bb87b4b9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790945603.919270:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87b4b9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790945603.919317:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb87b4bd000 for lustre-OST0001 00000001:00100000:0.0:1790945603.923696:0:5846:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 532c7531-c10c-43ae-8cad-28d7c162ca26 00000001:00080000:0.0:1790945603.923782:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1790945603.923788:0:5846:0:(genops.c:885:class_export_put()) final put ffff9bb865edb800/532c7531-c10c-43ae-8cad-28d7c162ca26 00000020:00000080:2.0:1790945603.924180:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb865edb800/532c7531-c10c-43ae-8cad-28d7c162ca26 for lustre-MDT0000 00000020:00000080:2.0:1790945603.924240:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb865eda800 for lustre-MDT0000 00010000:00010000:2.0:1790945604.316859:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945605.339991:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945606.364099:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790945606.427953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790945606.427960:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790945606.427964:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bb87fbcf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790945606.427972:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 347 00000100:00080000:0.0:1790945606.427991:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790945606.428002:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bb87fbcf000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1790945606.428025:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87b377100 x1877942273657472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790945606.428054:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790945606.428058:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790945606.428060:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bb87fb61000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790945606.428064:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 347 00000100:00080000:0.0:1790945606.428067:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790945606.428071:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bb87fb61000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1790945606.428082:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87b376a00 x1877942273657600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790945606.428239:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1877942273657472:0@lo:38:kworker.0 00000100:00100000:3.0:1790945606.428259:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273657344:0@lo:400:kworker.0 00000100:00100000:2.0:1790945606.428879:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945606.429023:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1877942273657600:0@lo:38:kworker.0 00000100:00100000:2.0:1790945606.429052:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945606.432447:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945606.432700:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273657472 00000100:00100000:1.0:1790945606.432711:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273657472 00000100:00100000:1.0:1790945606.432753:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273657600 00000100:00100000:1.0:1790945606.432756:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273657600 00000100:00100000:1.0:1790945606.432789:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790945606.432797:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3291:x1877942273657472:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1790945606.432816:0:5824:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790945606.437475:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3291:x1877942273657472:12345-0@lo:38:kworker.0 Request processed in 4666us (8585us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790945606.437489:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790945606.437528:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790945606.437534:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3291:x1877942273657600:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1790945606.437550:0:5824:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790945606.437579:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3291:x1877942273657600:12345-0@lo:38:kworker.0 Request processed in 44us (8526us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790945606.437585:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790945606.438468:0:5815:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273657344 00000100:00100000:1.0:1790945606.438478:0:5815:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273657344 00000100:00100000:1.0:1790945606.438519:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1790945606.438527:0:5815:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb84573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:3294:x1877942273657344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945606.438597:0:5815:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb84573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618+14:3294:x1877942273657344:12345-0@lo:400:kworker.0 Request processed in 72us (6158us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945606.438604:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:2.0:1790945606.439003:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb87fb61000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790945606.439010:0:3291:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790945606.439015:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1877942273657600:0@lo:38:kworker.0 00000100:00080000:2.0:1790945606.439044:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb87fbcf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790945606.439047:0:3291:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790945606.439050:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1877942273657472:0@lo:38:kworker.0 00000100:00100000:3.0:1790945606.440491:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3294:1877942273657344:0@lo:400:kworker.0 00000020:01000000:2.0:1790945607.387803:0:12896:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9bb847e769c0 - data ffff9bb84ef6e438/ffff9bb88146a400 00000020:01000000:2.0:1790945607.387951:0:12896:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9bb8583ef000 - data ffff9bb84eee5288/ffff9bb874a87800 00010000:00010000:0.0:1790945607.388464:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1790945607.395126:0:12896:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1790945607.447827:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790945607.447836:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1790945607.447856:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790945607.447859:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790945607.448912:0:6815:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790945607.448917:0:6815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1790945607.448927:0:6815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1790945607.450037:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790945607.450042:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1790945607.450061:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790945607.450063:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790945607.450396:0:7917:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790945607.450401:0:7917:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1790945607.450411:0:7917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1790945607.513228:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54ef16 00000020:00000080:2.0:1790945607.513241:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb880e93800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790945607.513842:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb880e93800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790945607.515039:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54ef2b 00000020:00000080:2.0:1790945607.515061:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb87b5e6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790945607.515087:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1790945607.515092:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790945607.515101:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790945607.515106:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9bb842ec4d40) has no exports 00000004:01000000:2.0:1790945607.515267:0:12896:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1790945607.515276:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f169 00000020:00000080:2.0:1790945607.515280:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb87b4be800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790945607.515284:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1790945607.515288:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790945607.515295:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790945607.515298:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9bb865fe99c0) has no exports 00000020:00000080:2.0:1790945607.515304:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f162 00000020:00000080:2.0:1790945607.515307:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb865e71000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790945607.516072:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87b5e6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1790945607.516084:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87b4be800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790945607.516089:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb865e71000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1790945607.516241:0:12896:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1790945607.516246:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790945607.516249:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1790945607.516255:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790945607.516257:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790945607.516334:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790945607.516344:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790945607.516352:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f082 00000020:00000080:2.0:1790945607.516359:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb87b250800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790945607.516963:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb865e70000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790945607.516971:0:36:0:(genops.c:885:class_export_put()) final put ffff9bb87b254000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790945607.516973:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87b254000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1790945607.516980:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790945607.517123:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1790945607.517129:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790945607.517136:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790945607.517139:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9bb865feb380) has no exports 00000020:00000080:2.0:1790945607.517146:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f07b 00000020:00000080:2.0:1790945607.517150:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb87b256800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1790945607.517542:0:12896:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1790945607.517547:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790945607.517562:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1790945607.517573:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790945607.517575:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790945607.517604:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790945607.517610:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790945607.517637:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790945607.517640:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790945607.517643:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb880e95800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790945607.517646:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb880e95800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1790945607.517651:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790945607.517979:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54ef32 00000020:00000080:2.0:1790945607.517987:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb87b5e1800/lustre-MDD0000_UUID 00000020:01000000:2.0:1790945607.517991:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1790945607.517995:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790945607.518000:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790945607.518002:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9bb87b5d3380) has no exports 00000020:00000080:2.0:1790945607.518022:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790945607.518025:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1790945607.518029:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54ef39 00000020:00000080:2.0:1790945607.518032:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb87b5e5000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1790945607.518040:0:12896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb845514800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1790945607.518044:0:12896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bb845514800 3 00000020:01000004:2.0:1790945607.518047:0:12896:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bb845514800 from lustre-MDT0000 00000020:00000080:2.0:1790945607.518066:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790945607.518069:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1790945607.518072:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb880e90800/lustre-MDT0000_UUID 00000020:00000080:2.0:1790945607.518074:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb880e90800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1790945607.518081:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1790945607.518107:0:12896:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1790945607.518110:0:12896:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1790945607.518114:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1790945607.518116:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790945607.518119:0:12896:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790945607.518126:0:12896:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9bb85229b000 bd8d2e96-ca7b-43e8-9882-d7f8a73e9618 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790945607.518137:0:12896:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9bb842ec3380) has exports, disconnecting them 00000020:00080000:2.0:1790945607.518141:0:12896:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9bb85229b000), last request at 1790945377 00000020:00000080:2.0:1790945607.518155:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54eed7 00000020:00010000:2.0:1790945607.518159:0:12896:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bb85229b000: total 4 00000100:00080000:2.0:1790945607.518162:0:12896:0:(import.c:65:import_set_state_nolock()) ffff9bb85229b800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1790945607.518251:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87b250800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790945607.518259:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87b256800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790945607.518263:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb87b251000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790945607.518268:0:36:0:(genops.c:885:class_export_put()) final put ffff9bb87fbca800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790945607.518270:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87fbca800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1790945607.518274:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790945607.518343:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87b5e1800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1790945607.518347:0:36:0:(genops.c:885:class_export_put()) final put ffff9bb872f97800/lustre-MDD0000_UUID 00000020:00000080:0.0:1790945607.518349:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb872f97800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1790945607.518353:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1790945607.518506:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87b5e5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1790945607.518544:0:12896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bb85229b000): rc 0 00000020:00080000:2.0:1790945607.518549:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9bb842ec3380) has no exports 00000100:00100000:2.0:1790945607.519987:0:5815:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff9bb865c21a00:5815] 0 exiting: rc = 1 00000100:00100000:0.0:1790945607.520146:0:5817:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff9bb865c20600:5817] 1 exiting: rc = 0 00000100:00100000:0.0:1790945607.520825:0:5818:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff9bb851303c00:5818] 2 exiting: rc = 0 00000100:00100000:2.0:1790945607.520944:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.520953:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.520959:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.520965:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.520973:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.520978:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.520984:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.520990:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.520996:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521002:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521008:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521015:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521021:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521027:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521034:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521040:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521046:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521053:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521060:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521066:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521072:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521078:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521085:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521096:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521103:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521123:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521129:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521135:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521141:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521147:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521152:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521158:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521163:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521169:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521174:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521180:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521186:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521192:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521197:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521202:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521207:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521212:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521218:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521224:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521229:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521235:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521241:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521245:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521251:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521257:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521262:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521267:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521273:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521279:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521285:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521291:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521297:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521302:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521308:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521312:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521327:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521332:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521338:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.521343:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1790945607.521992:0:12896:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790945607.521997:0:12896:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:1.0:1790945607.522904:0:5811:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bb85229b000: total 0 00010000:00010000:1.0:1790945607.522956:0:5811:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bb85229b000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1790945607.522989:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a7000/0xc5cf2c2a6a54f1e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f1e0 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945607.523009:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a7e00/0xc5cf2c2a6a54f1f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f1ee expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945607.523020:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8434ae800/0xc5cf2c2a6a54f203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f1fc expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945607.523031:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb87b132000/0xc5cf2c2a6a54f41e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f417 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945607.523041:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb84167ba00/0xc5cf2c2a6a54f22d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f226 expref: 5 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945607.523051:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8434afe00/0xc5cf2c2a6a54f42c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f425 expref: 4 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945607.523069:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a6c00/0xc5cf2c2a6a54efef lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54efe8 expref: 3 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945607.523084:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8414a7400/0xc5cf2c2a6a54f1d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc5cf2c2a6a54f1d2 expref: 2 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945607.523093:0:5811:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bb85229b000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1790945607.523116:0:5811:0:(genops.c:885:class_export_put()) final put ffff9bb85229b000/bd8d2e96-ca7b-43e8-9882-d7f8a73e9618 00000020:00000080:1.0:1790945607.523138:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb85229b000/bd8d2e96-ca7b-43e8-9882-d7f8a73e9618 for MGS 00000020:00000080:1.0:1790945607.523168:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb85229b800 for MGS 00010000:00010000:1.0:1790945607.523178:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945607.523181:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945607.523183:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790945607.525367:0:12896:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9bb847e76780 - data ffff9bb86d345870/ffff9bb881807400 00000020:01000000:2.0:1790945607.525496:0:12896:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9bb852154780 - data ffff9bb8486aa6c0/ffff9bb865d4cc00 00000020:00000080:2.0:1790945607.526195:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54eebb 00000020:00000080:2.0:1790945607.526204:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb8715b6800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1790945607.526230:0:12896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb845514800 from MGS, refs=2 00000020:01000004:2.0:1790945607.526235:0:12896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bb845514800 2 00000020:01000004:2.0:1790945607.526237:0:12896:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bb845514800 from MGS 00000020:00000080:2.0:1790945607.526265:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790945607.526272:0:12896:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1790945607.526275:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb8715b0000/MGS 00000020:00000080:2.0:1790945607.526278:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb8715b0000/MGS for MGS 00000020:01000000:2.0:1790945607.526285:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1790945607.526342:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1790945607.526347:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790945607.526352:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790945607.526360:0:12896:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9bb87b5e2000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790945607.526365:0:12896:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9bb865f819c0) has exports, disconnecting them 00000020:00080000:2.0:1790945607.526504:0:12896:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9bb87b5e2000), last request at 1790945378 00000020:00000080:2.0:1790945607.526511:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54ef86 00000020:00080000:2.0:1790945607.526518:0:12896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bb87b5e2000): rc 0 00000020:00000080:2.0:1790945607.526523:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb87b5e2000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1790945607.527255:0:12896:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1790945607.527261:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790945607.527266:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790945607.527272:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790945607.527465:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790945607.527472:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1790945607.527477:0:12896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bb845514800 1 00000020:00000080:2.0:1790945607.527482:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54eead 00000020:00000080:2.0:1790945607.527487:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb8715b0800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1790945607.527491:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1790945607.527494:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790945607.527498:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790945607.527500:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9bb842ec19c0) has no exports 00000020:00000080:1.0:1790945607.527839:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb8715b6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790945607.527848:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87b5e2000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790945607.527854:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb850e93000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790945607.527867:0:8:0:(genops.c:885:class_export_put()) final put ffff9bb850e91800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790945607.527869:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb850e91800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1790945607.527875:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1790945607.527933:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb8715b0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790945607.570512:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945607.570527:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790945607.570532:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb845511000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790945607.570537:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb845511000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790945607.570544:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790945607.570726:0:12896:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bb845515000 00000020:01000000:1.0:1790945607.570747:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790945607.570751:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790945607.570756:0:12896:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790945607.570760:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9bb86560b380) has no exports 00000100:00100000:1.0:1790945607.570825:0:5823:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff9bb85a79d400:5823] 0 exiting: rc = 1 00000100:00100000:1.0:1790945607.570925:0:7211:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff9bb87f9cd000:7211] 3 exiting: rc = 0 00000100:00100000:0.0:1790945607.573600:0:5825:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff9bb871688000:5825] 2 exiting: rc = 0 00000100:00100000:0.0:1790945607.573721:0:5824:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff9bb871688800:5824] 1 exiting: rc = 0 00000100:00100000:1.0:1790945607.573981:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.573988:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.573993:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.573999:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574005:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574024:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574030:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574036:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574041:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574046:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574051:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574056:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574061:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574066:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574071:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574076:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574081:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574086:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574091:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574096:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574101:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574106:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574113:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574118:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574123:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574129:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574134:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574140:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574145:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574150:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574166:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574173:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574179:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574185:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574190:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574196:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574201:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574206:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574211:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574216:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574230:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574236:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574240:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574245:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574251:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574257:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574263:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574269:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574275:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574280:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574286:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574293:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574300:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574305:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574311:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574317:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574322:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574328:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574333:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574338:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574343:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574347:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574353:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.574363:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580502:0:5826:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9bb871689400:5826] 0 exiting: rc = 1 00000100:00100000:1.0:1790945607.580748:0:5827:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9bb842e99e00:5827] 1 exiting: rc = 0 00000100:00100000:0.0:1790945607.580845:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580854:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580860:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580867:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580872:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580878:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580884:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580890:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580897:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580903:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580909:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580915:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580923:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580928:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580949:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580954:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580958:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580964:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580969:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580973:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580978:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580983:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580987:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580993:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.580997:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581002:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581007:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581012:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581017:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581022:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581027:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581031:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581036:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581040:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581045:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581050:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581056:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581061:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581066:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581071:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581076:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581081:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581087:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581092:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581098:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581103:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581109:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581114:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581119:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581132:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581137:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581142:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581148:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581152:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581158:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581163:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581167:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581172:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581177:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581182:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581187:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581191:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581196:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.581200:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.581812:0:5828:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff9bb871688a00:5828] 0 exiting: rc = 1 00000100:00100000:2.0:1790945607.594281:0:5829:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff9bb850e67600:5829] 1 exiting: rc = 0 00000100:00100000:0.0:1790945607.594442:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594470:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594478:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594483:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594490:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594496:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594502:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594508:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594514:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594521:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594528:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594533:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594539:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594570:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594577:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594584:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594590:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594596:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594601:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594607:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594625:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594631:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594636:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594642:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594648:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594896:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594905:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594911:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594917:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594924:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594929:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594935:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594942:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594948:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594954:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594962:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594968:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594989:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.594998:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595004:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595011:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595020:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595028:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595034:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595040:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595047:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595056:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595062:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595068:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595092:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595099:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595105:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595111:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595118:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595124:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595138:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595145:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595151:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595159:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595165:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595175:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595181:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595187:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.595201:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.611749:0:5831:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9bb850e67800:5831] 1 exiting: rc = 0 00000100:00100000:0.0:1790945607.613770:0:5830:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9bb850e66c00:5830] 0 exiting: rc = 1 00000100:00100000:1.0:1790945607.613855:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613863:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613869:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613873:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613877:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613883:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613888:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613893:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613899:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613919:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613924:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613928:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613933:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613938:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613944:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613949:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613954:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613960:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613965:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613969:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613974:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613979:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613984:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613988:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613993:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.613998:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614003:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614007:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614013:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614017:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614021:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614026:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614030:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614035:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614040:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614047:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614052:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614057:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614062:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614066:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614071:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614075:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614080:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614085:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614095:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614100:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614105:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614110:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614115:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614120:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614125:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614130:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614135:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614139:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614144:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614149:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614153:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614158:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614163:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614168:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614172:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614177:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614181:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.614186:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.614725:0:5833:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9bb850e66a00:5833] 1 exiting: rc = 0 00000100:00100000:0.0:1790945607.615195:0:5832:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9bb850e66400:5832] 0 exiting: rc = 1 00000100:00100000:1.0:1790945607.616863:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.616954:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.616959:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.616964:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.616970:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.616974:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.616980:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.616985:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.616990:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.616996:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617001:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617006:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617011:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617016:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617021:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617041:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617046:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617051:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617056:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617061:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617066:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617071:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617076:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617082:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617088:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617092:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617098:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617103:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617108:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617113:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617117:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617122:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617127:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617131:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617137:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617141:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617145:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617150:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617155:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617161:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617166:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617171:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617176:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617181:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617188:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617193:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617198:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617203:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617208:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617213:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617226:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617231:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617236:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617241:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617247:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617252:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617258:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617263:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617268:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617274:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617279:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617283:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617289:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.617294:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.623866:0:5835:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff9bb850e66e00:5835] 1 exiting: rc = 0 00000100:00100000:1.0:1790945607.626985:0:5834:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff9bb850e67400:5834] 0 exiting: rc = 1 00000100:00100000:0.0:1790945607.627340:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627348:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627354:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627359:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627365:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627379:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627385:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627391:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627396:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627401:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627406:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627411:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627417:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627425:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627430:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627435:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627440:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627446:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627451:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627456:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627461:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627466:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627471:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627477:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627499:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627504:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627510:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627514:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627519:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627524:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627528:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627533:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627538:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627542:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627547:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627564:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627568:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627573:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627578:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627583:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627588:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627593:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627599:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627605:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627610:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627615:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627620:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627624:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627629:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627633:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627637:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627642:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627647:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627652:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627866:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627873:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627877:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627882:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627886:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627897:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627901:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627906:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627916:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945607.627923:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945607.629194:0:5837:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff9bb842e98600:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1790945607.629263:0:5838:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff9bb842e99000:5838] 1 exiting: rc = 0 00000100:00100000:2.0:1790945607.629405:0:5839:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff9bb842e99600:5839] 2 exiting: rc = 0 00000100:00100000:1.0:1790945607.629511:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629519:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629541:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629547:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629553:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629558:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629565:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629570:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629576:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629582:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629588:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629593:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629598:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629604:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629611:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629616:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629622:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629628:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629634:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629640:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629886:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629897:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629904:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629910:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629916:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629921:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629940:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629947:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629953:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629959:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629966:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629971:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629978:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629983:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629990:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.629995:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630000:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630006:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630011:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630017:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630022:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630028:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630034:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630039:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630045:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630051:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630057:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630063:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630069:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630074:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630093:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630099:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630105:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630111:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630116:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630127:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630132:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630138:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630144:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630150:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630156:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630163:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630168:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945607.630174:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790945607.636325:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945607.636337:0:12896:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1790945607.636343:0:12896:0:(genops.c:885:class_export_put()) final put ffff9bb865610800/MDS_uuid 00000020:00000080:1.0:1790945607.636347:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb865610800/MDS_uuid for MDS 00000020:01000000:1.0:1790945607.636352:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1790945607.636478:0:12896:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1790945608.411861:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945609.440603:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945610.460951:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790945610.825602:0:13053:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790945610.847799:0:13053:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1790945610.847844:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945610.847859:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945610.847867:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945610.847874:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945610.847894:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790945610.847900:0:13053:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790945610.847928:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790945610.847932:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790945610.847937:0:13053:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790945610.847943:0:13053:0:(import.c:65:import_set_state_nolock()) ffff9bb87fbcf000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1790945610.847948:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790945610.847949:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790945610.847952:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790945610.848867:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945610.848894:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945610.848900:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945610.848906:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945610.848925:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790945610.848930:0:13053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945610.848937:0:13053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945610.848944:0:13053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945610.848950:0:13053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945610.848957:0:13053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1790945610.848960:0:13053:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1790945610.848978:0:13053:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1790945610.848982:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1790945610.848986:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790945610.848991:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790945610.848995:0:13053:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9bb865f84d40) has no exports 00000020:00080000:0.0:1790945610.849022:0:13053:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9bb865f84d40) has no exports 00000020:01000000:0.0:1790945610.850773:0:13053:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9bb742389300 - data ffff9bb86d28c0d8/ffff9bb873874400 00000020:01000000:0.0:1790945610.850923:0:13053:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9bb87fe3f900 - data ffff9bb84eee2e58/ffff9bb880ea6c00 00010000:00010000:2.0:1790945610.851450:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790945610.851460:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.851469:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434ae200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945610.851473:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.851483:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945610.851491:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945610.851496:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790945610.851499:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790945610.851514:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790945610.851538:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790945610.851553:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.851559:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945610.851579:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.851586:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8434ae200/0xc5cf2c2a6a54f1ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f1f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.851597:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945610.851600:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.851605:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434af200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945610.851607:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.851614:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945610.851620:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945610.851625:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790945610.851627:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790945610.851629:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790945610.851641:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.851647:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945610.851876:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.851882:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8434af200/0xc5cf2c2a6a54f425 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f42c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.851891:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945610.851893:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945610.851895:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945610.852005:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273657856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945610.852073:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945610.852079:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273657728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945610.852104:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945610.852197:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273657856 00000100:00100000:3.0:1790945610.852207:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273657856 00000100:00100000:3.0:1790945610.852237:0:8440:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273657728 00000100:00100000:3.0:1790945610.852239:0:8440:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273657728 00000100:00100000:3.0:1790945610.852257:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790945610.852264:0:8440:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3292:x1877942273657856:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790945610.852277:0:8440:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790945610 with bad export cookie 14253659906335108823 00010000:00010000:2.0:1790945610.852318:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945610.852324:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.852331:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1ce00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945610.852333:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.852354:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945610.852361:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945610.852367:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790945610.852369:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1790945610.852371:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1790945610.852387:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.852401:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945610.852415:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.852421:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb865d1ce00/0xc5cf2c2a6a54f1fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc5cf2c2a6a54f203 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945610.852430:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945610.852432:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945610.852434:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945610.852442:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273657984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945610.852468:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945610.852488:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945610.852491:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945610.852692:0:5810:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273657984 00000100:00100000:1.0:1790945610.852696:0:5810:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273657984 00000100:00100000:2.0:1790945610.852705:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790945610.852711:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c933480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3295:x1877942273657728:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790945610.852716:0:5808:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790945610 with bad export cookie 14253659906335108823 00000100:00100000:2.0:1790945610.852763:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c933480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3295:x1877942273657728:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (658us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790945610.859577:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790945610.859638:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790945610.859648:0:5808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c933100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3293:x1877942273657984:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790945610.859670:0:5808:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790945610 with bad export cookie 14253659906335108823 00000100:00100000:2.0:1790945610.859771:0:5808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c933100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3293:x1877942273657984:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (7302us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790945610.859778:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1790945610.859846:0:3295:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790945610.859851:0:3295:0:(import.c:65:import_set_state_nolock()) ffff9bb865612800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1790945610.859855:0:3295:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1790945610.859934:0:3293:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1790945610.862314:0:8440:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3292:x1877942273657856:12345-0@lo:103:ldlm_bl.0 Request processed in 10044us (10236us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790945610.862327:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1790945610.862394:0:3292:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790945610.880129:0:3295:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.148@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1790945610.880134:0:3295:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790945610.880144:0:3295:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb86c930380 x1877942273657856/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790945626 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945610.880159:0:3295:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb86c931500 x1877942273657728/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790945626 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945610.880170:0:3295:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb86c933b80 x1877942273657984/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790945626 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790945610.880222:0:3293:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9bb865612800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1790945610.880244:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3293:1877942273657984:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1790945610.880640:0:3292:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9bb865612800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1790945610.880652:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3292:1877942273657856:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1790945610.881648:0:3295:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790945610.881653:0:3295:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790945610.881654:0:3295:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1790945610.881760:0:3295:0:(import.c:65:import_set_state_nolock()) ffff9bb865612800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790945610.881767:0:3295:0:(import.c:545:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 123 00000100:00080000:2.0:1790945610.881781:0:3295:0:(import.c:666:import_select_connection()) MGC192.168.202.148@tcp: import ffff9bb865612800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1790945610.881813:0:3295:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb86c933800 x1877942273658112/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790945610.881872:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3291:1877942273658112:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1790945610.881925:0:3291:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877942273658112 offset 0 length 520: 4 00000100:00100000:2.0:1790945610.881988:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3295:1877942273657728:0@lo:103:ldlm_bl.0 00100000:10000000:0.0:1790945610.905846:0:13053:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790945610.931981:0:13053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f00b 00000020:00000080:1.0:1790945610.931991:0:13053:0:(genops.c:885:class_export_put()) final put ffff9bb87fbc9800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1790945610.932011:0:13053:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb8654d2800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1790945610.932025:0:13053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bb8654d2800 2 00000020:01000004:1.0:1790945610.932028:0:13053:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bb8654d2800 from lustre-OST0000 00000020:00000080:1.0:1790945610.932051:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945610.932061:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1790945610.932064:0:13053:0:(genops.c:885:class_export_put()) final put ffff9bb87fbcb800/lustre-OST0000_UUID 00000020:00000080:1.0:1790945610.932067:0:13053:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87fbcb800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1790945610.932074:0:13053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1790945610.932127:0:13053:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1790945610.932132:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1790945610.932135:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790945610.932140:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790945610.932146:0:13053:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9bb877a81800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790945610.932152:0:13053:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9bb865f80000) has exports, disconnecting them 00000020:00080000:1.0:1790945610.932156:0:13053:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9bb877a81800), last request at 1790945398 00000020:00000080:1.0:1790945610.932160:0:13053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f035 00000020:00080000:1.0:1790945610.932169:0:13053:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bb877a81800): rc 0 00000020:00000080:1.0:1790945610.932174:0:13053:0:(genops.c:885:class_export_put()) final put ffff9bb877a81800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790945610.932885:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87fbc9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790945610.932898:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb877a81800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1790945610.936949:0:13053:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790945610.936960:0:13053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790945610.936965:0:13053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790945610.936972:0:13053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790945610.937174:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790945610.937183:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1790945610.937189:0:13053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bb8654d2800 1 00000020:00000080:0.0:1790945610.937195:0:13053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54efc5 00000020:00000080:0.0:1790945610.937203:0:13053:0:(genops.c:885:class_export_put()) final put ffff9bb86caec800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1790945610.937209:0:13053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1790945610.937216:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790945610.937220:0:13053:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790945610.937224:0:13053:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9bb865f83380) has no exports 00000020:00000080:3.0:1790945610.937489:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb87fbcf000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790945610.937498:0:8:0:(genops.c:885:class_export_put()) final put ffff9bb87fbce000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1790945610.937501:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87fbce000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1790945610.937507:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1790945610.937584:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb86caec800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790945610.964361:0:13053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790945610.964377:0:13053:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1790945610.964383:0:13053:0:(genops.c:885:class_export_put()) final put ffff9bb8654d3000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1790945610.964387:0:13053:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb8654d3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1790945610.964398:0:13053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1790945610.964872:0:13053:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bb8654d6000 00000020:02000400:3.0:1790945610.964923:0:13053:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1790945611.485316:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790945611.549820:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) bd8d2e96-ca7b-43e8-9882-d7f8a73e9618->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790945611.549832:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) bd8d2e96-ca7b-43e8-9882-d7f8a73e9618->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790945611.549835:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790945611.549838:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790945611.549842:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bb87fb61000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790945611.549851:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 352 00000100:00080000:2.0:1790945611.549875:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790945611.549890:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bb87fb61000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1790945611.549939:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb86c931500 x1877942273658240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790945611.550139:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1877942273658240:0@lo:38:kworker.0 00000400:00000100:3.0:1790945611.550210:0:3291:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877942273658240 offset 0 length 520: 4 00010000:00010000:1.0:1790945612.511259:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945613.531867:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790945613.966042:0:13204:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790945613.991295:0:13204:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1790945613.991393:0:13204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945613.991419:0:13204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945613.991427:0:13204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945613.991454:0:13204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945613.991478:0:13204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790945613.991484:0:13204:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790945613.991516:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1790945613.992033:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945613.992043:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945613.992051:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167aa00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945613.992055:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945613.992073:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945613.992079:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945613.992085:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790945613.992087:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790945613.992089:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790945613.992113:0:5812:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bb865612800 00010000:00010000:2.0:1790945613.992117:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945613.992123:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb84167aa00/0xc5cf2c2a6a54f1d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5cf2c2a6a54f1d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945613.992134:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945613.992144:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945613.992146:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945613.992714:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb86c931500 x1877942273658240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790945631 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945613.992736:0:13204:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790945613.992744:0:13204:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790945613.992751:0:13204:0:(import.c:65:import_set_state_nolock()) ffff9bb87fb61000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1790945613.992757:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790945613.992761:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb86c931500 x1877942273658240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790945631 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945613.992767:0:13204:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790945613.992769:0:13204:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:3.0:1790945613.992884:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1877942273658240:0@lo:38:kworker.0 00010000:00010000:0.0:1790945613.997221:0:13204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945613.997241:0:13204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945613.997248:0:13204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945613.997255:0:13204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945613.997298:0:13204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790945613.997306:0:13204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945613.997323:0:13204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945613.997330:0:13204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945613.997337:0:13204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945613.997353:0:13204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790945613.997357:0:13204:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1790945613.997382:0:13204:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1790945613.997386:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1790945613.997390:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790945613.997396:0:13204:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790945613.997400:0:13204:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9bb87b47cd40) has no exports 00000020:00080000:0.0:1790945613.997422:0:13204:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9bb87b47cd40) has no exports 00010000:00010000:2.0:1790945613.997631:0:13054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790945613.997638:0:13054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945613.997646:0:13054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8434aec00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945613.997650:0:13054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945613.997674:0:13054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945613.997682:0:13054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945613.997688:0:13054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790945613.997690:0:13054:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1790945613.997692:0:13054:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1790945613.997704:0:13054:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bb865612800 00010000:00010000:2.0:1790945613.997707:0:13054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945613.997714:0:13054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8434aec00/0xc5cf2c2a6a54f1e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5cf2c2a6a54f1e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945613.997727:0:13054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945613.997731:0:13054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945613.997737:0:13054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c600 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945613.997747:0:13054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945613.997754:0:13054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945613.997761:0:13054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945613.997766:0:13054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790945613.997768:0:13054:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790945613.997770:0:13054:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790945613.997776:0:13054:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bb865612800 00010000:00010000:2.0:1790945613.997778:0:13054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945613.997784:0:13054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c600/0xc5cf2c2a6a54f417 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5cf2c2a6a54f41e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945613.997797:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945613.997799:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945613.997801:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945613.997855:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790945614.001711:0:13204:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9bb742389540 - data ffff9bb86d28c438/ffff9bb873874800 00000020:01000000:1.0:1790945614.002086:0:13204:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9bb8520bd900 - data ffff9bb877c20870/ffff9bb8817f7000 00100000:10000000:1.0:1790945614.021562:0:13204:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1790945614.070856:0:13204:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f0d6 00000020:00000080:3.0:1790945614.070866:0:13204:0:(genops.c:885:class_export_put()) final put ffff9bb87fbcb000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1790945614.070883:0:13204:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb87fbcd800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1790945614.070886:0:13204:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bb87fbcd800 2 00000020:01000004:3.0:1790945614.070904:0:13204:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bb87fbcd800 from lustre-OST0001 00000020:00000080:3.0:1790945614.070929:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790945614.070939:0:13204:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1790945614.070942:0:13204:0:(genops.c:885:class_export_put()) final put ffff9bb865ed8000/lustre-OST0001_UUID 00000020:00000080:3.0:1790945614.070946:0:13204:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb865ed8000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1790945614.070953:0:13204:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1790945614.071065:0:13204:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import bd8d2e96-ca7b-43e8-9882-d7f8a73e9618->MGS 00010000:00010000:3.0:1790945614.071081:0:13204:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb84167b200/0xc5cf2c2a6a54efe8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5cf2c2a6a54efef expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945614.071092:0:13204:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb84167b200/0xc5cf2c2a6a54efe8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5cf2c2a6a54efef expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945614.071098:0:13204:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1790945614.071115:0:13204:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1790945614.071118:0:13204:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1790945614.071137:0:13204:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bb865612800 00010000:00010000:3.0:1790945614.071142:0:13204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb84167b200/0xc5cf2c2a6a54efe8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5cf2c2a6a54efef expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945614.071157:0:13204:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb865d1dc00/0xc5cf2c2a6a54f226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc5cf2c2a6a54f22d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945614.071164:0:13204:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb865d1dc00/0xc5cf2c2a6a54f226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc5cf2c2a6a54f22d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945614.071169:0:13204:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790945614.071171:0:13204:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1790945614.071173:0:13204:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1790945614.071181:0:13204:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bb865612800 00010000:00010000:3.0:1790945614.071185:0:13204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb865d1dc00/0xc5cf2c2a6a54f226 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc5cf2c2a6a54f22d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790945614.071216:0:13204:0:(import.c:65:import_set_state_nolock()) ffff9bb865612800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1790945614.071220:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1790945614.071222:0:13204:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1790945614.071224:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1790945614.071227:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1790945614.071238:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bb86c933800 x1877942273658112/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790945620 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1790945614.071253:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790945614.071256:0:13204:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:3.0:1790945614.071285:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd8d2e96-ca7b-43e8-9882-d7f8a73e9618:3291:1877942273658112:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:3.0:1790945614.071318:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1790945614.071325:0:13204:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54eec9 00000020:00000080:3.0:1790945614.071330:0:13204:0:(genops.c:885:class_export_put()) final put ffff9bb865612000/bd8d2e96-ca7b-43e8-9882-d7f8a73e9618 00000020:01000000:3.0:1790945614.071334:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.148@tcp (flags='') 00000020:00000080:3.0:1790945614.071340:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790945614.071345:0:13204:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.148@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790945614.071348:0:13204:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9bb8656099c0) has no exports 10000000:01000000:3.0:1790945614.071365:0:5820:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1790945614.071408:0:13204:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.202.148@tcp: client import never connected 00000100:00080000:3.0:1790945614.071410:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1790945614.071412:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790945614.071414:0:13204:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1790945614.071416:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1790945614.071444:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790945614.071447:0:13204:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.148@tcp (uuid bd8d2e96-ca7b-43e8-9882-d7f8a73e9618) 00000020:01000000:3.0:1790945614.071452:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1790945614.071455:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790945614.071457:0:13204:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790945614.071462:0:13204:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9bb87fb67800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790945614.071476:0:13204:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9bb865fe8000) has exports, disconnecting them 00000020:00080000:3.0:1790945614.071480:0:13204:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9bb87fb67800), last request at 1790945420 00000020:00000080:3.0:1790945614.071484:0:13204:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f100 00000020:00080000:3.0:1790945614.071494:0:13204:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bb87fb67800): rc 0 00000020:00000080:3.0:1790945614.071498:0:13204:0:(genops.c:885:class_export_put()) final put ffff9bb87fb67800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790945614.072244:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87fbcb000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1790945614.072259:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb865612000/bd8d2e96-ca7b-43e8-9882-d7f8a73e9618 for MGC192.168.202.148@tcp 00000020:00000080:0.0:1790945614.072263:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb865612800 for MGC192.168.202.148@tcp 00000020:00000080:0.0:1790945614.072269:0:8:0:(genops.c:885:class_export_put()) final put ffff9bb86ca2d800/bd8d2e96-ca7b-43e8-9882-d7f8a73e9618 00000020:00000080:0.0:1790945614.072271:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb86ca2d800/bd8d2e96-ca7b-43e8-9882-d7f8a73e9618 for MGC192.168.202.148@tcp 00000020:01000000:0.0:1790945614.072275:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.148@tcp (bd8d2e96-ca7b-43e8-9882-d7f8a73e9618) 00000020:00000080:0.0:1790945614.072512:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87fb67800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1790945614.073875:0:13204:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790945614.073881:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790945614.073885:0:13204:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790945614.073891:0:13204:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790945614.073995:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bb87fb61000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1790945614.106903:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1790945614.107323:0:13054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1790945614.107450:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1790945614.107685:0:5806:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9bb8518ba400:5806] 0 exiting: rc = 1 00000100:00100000:1.0:1790945614.108207:0:5807:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9bb8518bb600:5807] 1 exiting: rc = 0 00000100:00100000:1.0:1790945614.108271:0:7614:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9bb87faf3800:7614] 2 exiting: rc = 0 00000100:00100000:3.0:1790945614.108986:0:8439:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_003: service thread [ffff9bb85a0f4600:8439] 3 exiting: rc = 0 00000100:00100000:0.0:1790945614.113995:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.114393:0:5810:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9bb851e01800:5810] 2 exiting: rc = 0 00000100:00100000:0.0:1790945614.114517:0:5808:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9bb851e01e00:5808] 0 exiting: rc = 1 00000100:00100000:0.0:1790945614.114567:0:5809:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9bb851e00c00:5809] 1 exiting: rc = 0 00000100:00100000:0.0:1790945614.114616:0:8440:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9bb877a56a00:8440] 3 exiting: rc = 0 00000100:00100000:1.0:1790945614.114925:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.114933:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.114940:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.114945:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.114950:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.114971:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.114977:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.114982:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.114988:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.114993:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.114998:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115004:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115011:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115017:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115022:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115029:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115034:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115039:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115044:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115048:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115053:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115058:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115062:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115067:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115072:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115077:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115084:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115089:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115095:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115100:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115104:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115110:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115114:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115119:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115124:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115129:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115134:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115138:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115143:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115147:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115160:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115165:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115171:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115176:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115180:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115186:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115191:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115196:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115201:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115206:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115211:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115217:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115222:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115227:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115232:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115237:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115242:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115247:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115251:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115256:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115261:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115266:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115271:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.115276:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790945614.119155:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945614.119169:0:13204:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1790945614.119188:0:13204:0:(genops.c:885:class_export_put()) final put ffff9bb877be8000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1790945614.119192:0:13204:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb877be8000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1790945614.119198:0:13204:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1790945614.119258:0:13204:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bb87fbcd800 1 00000020:00000080:1.0:1790945614.119264:0:13204:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc5cf2c2a6a54f0a5 00000020:00000080:1.0:1790945614.119270:0:13204:0:(genops.c:885:class_export_put()) final put ffff9bb877bea000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1790945614.119292:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1790945614.119296:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790945614.119320:0:13204:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790945614.119326:0:13204:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9bb865fecd40) has no exports 00000020:00000080:0.0:1790945614.119410:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb877bea000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1790945614.172580:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945614.172595:0:13204:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1790945614.172600:0:13204:0:(genops.c:885:class_export_put()) final put ffff9bb87fbca000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1790945614.172604:0:13204:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb87fbca000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790945614.172614:0:13204:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1790945614.172858:0:13204:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bb87fbc8000 00000020:01000000:1.0:1790945614.172879:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1790945614.172884:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790945614.172888:0:13204:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790945614.172892:0:13204:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9bb87b5d4d40) has no exports 00000020:00000080:1.0:1790945614.172918:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790945614.172924:0:13204:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1790945614.172926:0:13204:0:(genops.c:885:class_export_put()) final put ffff9bb86caed800/OSS_uuid 00000020:00000080:1.0:1790945614.172928:0:13204:0:(genops.c:844:class_export_destroy()) destroying export ffff9bb86caed800/OSS_uuid for OSS 00000020:01000000:1.0:1790945614.172932:0:13204:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1790945614.173001:0:6673:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff9bb850e81600:6673] 2 exiting: rc = 0 00000100:00080000:3.0:1790945614.173984:0:5819:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1790945614.177949:0:6670:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff9bb86556e000:6670] 0 exiting: rc = 1 00000100:00100000:2.0:1790945614.178082:0:7919:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff9bb86cb39a00:7919] 3 exiting: rc = 0 00000100:00100000:0.0:1790945614.190389:0:6672:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff9bb86556fe00:6672] 1 exiting: rc = 0 00000100:00100000:1.0:1790945614.194002:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194011:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194017:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194023:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194028:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194033:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194039:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194044:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194049:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194054:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194060:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194065:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194069:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194074:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194080:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194086:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194110:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194115:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194121:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194126:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194131:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194136:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194142:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194147:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194151:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194156:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194161:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194166:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194171:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194177:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194183:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194190:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194196:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194201:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194207:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194212:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194217:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194223:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194228:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194234:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194238:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194245:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194250:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194254:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194259:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194265:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194269:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194275:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194280:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194286:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194291:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194305:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194324:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194329:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194333:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194338:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194343:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194348:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194354:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194358:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194363:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194368:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194373:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.194379:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790945614.199838:0:12725:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9bb87fa35800:12725] 2 exiting: rc = 0 00000100:00100000:3.0:1790945614.199992:0:6675:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9bb850eb5c00:6675] 1 exiting: rc = 0 00000100:00100000:1.0:1790945614.200259:0:6674:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9bb850eb4a00:6674] 0 exiting: rc = 1 00000100:00100000:1.0:1790945614.200360:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200369:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200374:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200379:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200385:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200390:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200396:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200402:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200407:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200413:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200418:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200423:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200428:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200432:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200436:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200441:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200445:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200450:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200455:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200461:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200466:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200484:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200500:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200506:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200511:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200517:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200522:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200527:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200532:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200537:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200542:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200547:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200552:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200557:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200562:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200566:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200572:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200577:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200582:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200588:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200593:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200598:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200604:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200609:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200614:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200619:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200623:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200629:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200634:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200641:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200646:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200652:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200829:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200838:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200846:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200854:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200867:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200872:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200878:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200883:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200888:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200893:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200898:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790945614.200905:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.202178:0:6678:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9bb8818fde00:6678] 2 exiting: rc = 0 00000100:00100000:0.0:1790945614.203576:0:6677:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9bb8818fc000:6677] 1 exiting: rc = 0 00000100:00100000:1.0:1790945614.204674:0:6676:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9bb86556f200:6676] 0 exiting: rc = 1 00000100:00100000:3.0:1790945614.205093:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205101:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205107:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205113:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205119:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205125:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205134:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205139:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205145:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205151:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205156:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205162:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205167:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205175:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205180:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205185:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205191:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205196:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205201:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205218:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205223:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205229:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205235:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205240:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205247:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205252:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205257:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205262:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205267:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205272:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205289:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205295:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205300:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205319:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205326:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205332:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205338:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205343:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205348:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205353:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205358:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205365:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205370:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205375:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205381:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205386:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205392:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205397:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205403:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205408:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205413:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205419:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205424:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205429:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205450:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205456:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205461:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205467:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205473:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205479:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205484:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205489:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205495:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790945614.205500:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.227923:0:6679:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9bb8818fc600:6679] 0 exiting: rc = 1 00000100:00100000:2.0:1790945614.228874:0:6680:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9bb86556e400:6680] 1 exiting: rc = 0 00000100:00100000:2.0:1790945614.230810:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230818:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230826:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230832:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230837:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230859:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230865:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230870:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230876:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230881:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230886:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230942:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230948:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230953:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230959:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230964:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230970:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230976:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230982:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230988:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.230994:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231000:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231005:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231010:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231015:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231020:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231025:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231031:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231036:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231042:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231048:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231053:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231059:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231065:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231072:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231077:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231083:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231089:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231095:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231114:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231127:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231133:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231139:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231157:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231163:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231168:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231174:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231180:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231185:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231190:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231195:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231201:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231206:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231211:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231216:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231222:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231235:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231242:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231247:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231253:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231259:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231263:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231269:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.231274:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.236856:0:6682:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9bb88115c400:6682] 1 exiting: rc = 0 00000100:00100000:2.0:1790945614.239279:0:6681:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9bb8818fd000:6681] 0 exiting: rc = 1 00000100:00100000:2.0:1790945614.239415:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239424:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239429:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239435:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239441:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239446:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239451:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239457:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239462:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239483:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239489:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239496:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239941:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239950:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239957:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239963:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239968:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239974:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239980:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239986:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239991:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.239997:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240003:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240009:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240029:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240038:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240043:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240049:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240057:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240063:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240069:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240075:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240083:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240093:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240857:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240876:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240906:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240913:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240920:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240926:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240932:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240938:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240944:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240950:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240967:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240974:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240979:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.240986:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241006:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241013:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241019:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241025:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241032:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241039:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241045:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241053:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241058:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241064:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241071:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241077:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241096:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241588:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241597:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790945614.241603:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1790945614.272273:0:13204:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1790945632.457499:0:13824:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1790945641.854707:0:14286:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790945641.854712:0:14286:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1790945641.854820:0:14286:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bb87390c000 00000020:01000004:3.0:1790945641.854835:0:14286:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1790945641.854844:0:14286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1790945641.854858:0:14286:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9bb865fecd40) 00000020:00000080:3.0:1790945641.854872:0:14286:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1790945641.881484:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1790945641.884504:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1790945641.884919:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 535: rc = 0 00100000:10000000:0.0:1790945641.885016:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 535: rc = 0 00100000:10000000:0.0:1790945641.885202:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 535: rc = 0 00100000:10000000:0.0:1790945641.885541:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1790945641.885608:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 535: rc = 0 00100000:10000000:0.0:1790945641.885736:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 535: rc = 0 00100000:10000000:0.0:1790945641.885833:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 535: rc = 0 00100000:10000000:0.0:1790945641.886134:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 537: rc = 0 00100000:10000000:0.0:1790945641.887834:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 679: rc = 0 00100000:10000000:0.0:1790945641.887943:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 679: rc = 0 00100000:10000000:0.0:1790945641.888630:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 138: rc = 0 00100000:10000000:0.0:1790945641.888957:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 138: rc = 0 00100000:10000000:0.0:1790945641.889597:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 138: rc = 0 00100000:10000000:0.0:1790945641.889882:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 138: rc = 0 00100000:10000000:0.0:1790945641.890148:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 138: rc = 0 00100000:10000000:0.0:1790945641.890415:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 138: rc = 0 00100000:10000000:0.0:1790945641.890715:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 138: rc = 0 00100000:10000000:0.0:1790945641.890952:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 138: rc = 0 00100000:10000000:0.0:1790945641.891203:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 138: rc = 0 00100000:10000000:0.0:1790945641.891433:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 138: rc = 0 00100000:10000000:0.0:1790945641.891704:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 138: rc = 0 00100000:10000000:0.0:1790945641.891984:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 138: rc = 0 00100000:10000000:0.0:1790945641.893769:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 510: rc = 0 00100000:10000000:0.0:1790945641.894032:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 510: rc = 0 00100000:10000000:0.0:1790945641.898516:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 510: rc = 0 00100000:10000000:0.0:1790945641.898838:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 510: rc = 0 00100000:10000000:0.0:1790945641.899093:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 510: rc = 0 00100000:10000000:1.0:1790945641.900157:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 510: rc = 0 00100000:10000000:1.0:1790945641.900561:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 510: rc = 0 00100000:10000000:1.0:1790945641.900885:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 510: rc = 0 00100000:10000000:1.0:1790945641.901365:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 510: rc = 0 00100000:10000000:1.0:1790945641.902906:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 510: rc = 0 00100000:10000000:1.0:1790945641.903195:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 510: rc = 0 00100000:10000000:1.0:1790945641.903580:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 510: rc = 0 00100000:10000000:1.0:1790945641.903861:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 510: rc = 0 00100000:10000000:1.0:1790945641.904142:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 510: rc = 0 00100000:10000000:1.0:1790945641.904650:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 510: rc = 0 00100000:10000000:1.0:1790945641.904918:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 510: rc = 0 00100000:10000000:1.0:1790945641.905227:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 510: rc = 0 00100000:10000000:1.0:1790945641.905624:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 510: rc = 0 00100000:10000000:1.0:1790945641.906553:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 510: rc = 0 00100000:10000000:1.0:1790945641.906770:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 510: rc = 0 00100000:10000000:1.0:1790945641.906943:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 510: rc = 0 00100000:10000000:1.0:1790945641.907184:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 510: rc = 0 00100000:10000000:1.0:1790945641.907568:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 510: rc = 0 00100000:10000000:1.0:1790945641.907991:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 510: rc = 0 00100000:10000000:1.0:1790945641.908271:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 510: rc = 0 00100000:10000000:1.0:1790945641.908540:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 510: rc = 0 00100000:10000000:1.0:1790945641.908821:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 510: rc = 0 00100000:10000000:1.0:1790945641.909362:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 510: rc = 0 00100000:10000000:1.0:1790945641.909610:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 510: rc = 0 00100000:10000000:1.0:1790945641.909936:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 510: rc = 0 00100000:10000000:1.0:1790945641.910195:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 510: rc = 0 00100000:10000000:1.0:1790945641.910578:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 510: rc = 0 00100000:10000000:1.0:1790945641.910968:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 688: rc = 0 00100000:10000000:1.0:1790945641.911773:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1790945641.911901:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 495: rc = 0 00100000:10000000:1.0:1790945641.912036:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1790945641.912111:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 495: rc = 0 00100000:10000000:1.0:1790945641.912444:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1790945641.912514:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 495: rc = 0 00100000:10000000:1.0:1790945641.912882:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1790945641.912955:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 680: rc = 0 00100000:10000000:1.0:1790945641.913163:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1790945641.913230:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 680: rc = 0 00100000:10000000:1.0:1790945641.913550:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1790945641.913623:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 680: rc = 0 00000020:00000080:1.0:1790945641.913974:0:14286:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790945641.913982:0:14286:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790945641.913995:0:14286:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a5501bc 00000020:01000004:1.0:1790945641.914003:0:14286:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1790945641.914009:0:14286:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790945641.914014:0:14286:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bb87390c000 from MGS 00000020:01000004:1.0:1790945641.914024:0:14286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790945641.914035:0:14286:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9bb87b478000) 00000020:00000080:1.0:1790945641.914059:0:14286:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790945641.914113:0:14286:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb87390c000 from MGS, refs=2 00080000:01000000:1.0:1790945641.914119:0:14286:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790945641.914124:0:14286:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a5501ca 00000100:00100000:1.0:1790945641.914215:0:14286:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790945641.914451:0:14286:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790945641.914457:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1790945641.914913:0:14286:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1790945641.914918:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1790945641.915588:0:14286:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790945641.915859:0:14286:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1790945641.915863:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790945641.916220:0:14286:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790945641.916226:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790945641.916647:0:14286:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790945641.916653:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790945641.917493:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945641.917496:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945641.917499:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945641.917930:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945641.917933:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945641.917934:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945641.918839:0:14286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1790945641.923773:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1790945641.928426:0:14286:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1790945641.928445:0:14286:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790945641.928448:0:14286:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1790945641.934332:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1790945641.934524:0:14286:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1790945641.934634:0:14286:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790945641.935163:0:14286:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1790945641.935741:0:14286:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945641.935929:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1790945641.935935:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790945641.938984:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790945641.938995:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790945641.939351:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790945641.939358:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790945641.940293:0:14286:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790945641.940315:0:14286:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.148@tcp' 00000020:01000004:2.0:1790945641.940317:0:14286:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790945641.940346:0:14286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.148@tcp (typ=mgc) 00000020:00000080:2.0:1790945641.940359:0:14286:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.148@tcp (ffff9bb87b5d0000) 00000020:00000080:2.0:1790945641.940373:0:14286:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790945641.940452:0:14286:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb86cae9000@MGC192.168.202.148@tcp: add connection 192.168.202.148@tcp at head 00010000:00010000:2.0:1790945641.940596:0:14286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.148@tcp-0 is initialized 00000040:01000000:2.0:1790945641.940603:0:14286:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 1 is initialized 00000100:00080000:1.0:1790945641.945281:0:14300:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1790945641.945913:0:14301:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790945641.947582:0:14286:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.148@tcp (uuid 2ac65209-3704-434c-a055-442590f14168) 00000020:00000080:3.0:1790945641.947607:0:14286:0:(genops.c:1384:class_connect()) connect: client 2ac65209-3704-434c-a055-442590f14168, cookie 0xc5cf2c2a6a5501d8 00000100:00080000:3.0:1790945641.947619:0:14286:0:(import.c:545:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790945641.947631:0:14286:0:(import.c:666:import_select_connection()) MGC192.168.202.148@tcp: import ffff9bb86cae9000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1790945641.947799:0:14286:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87fe03480 x1877942273658368/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790945641.947820:0:14286:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2ac65209-3704-434c-a055-442590f14168->MGS 00000020:01000004:3.0:1790945641.947874:0:14286:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790945641.947879:0:14286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790945641.947892:0:14286:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9bb865fe8000) 00000020:00000080:3.0:1790945641.947903:0:14286:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790945641.955741:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2ac65209-3704-434c-a055-442590f14168:3291:1877942273658368:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790945641.955807:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945641.955927:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273658368 00000100:00100000:0.0:1790945641.955934:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273658368 00000100:00100000:0.0:1790945641.957341:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790945641.957351:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3291:x1877942273658368:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1790945641.957380:0:14297:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2ac65209-3704-434c-a055-442590f14168@0@lo t0 exp 0000000000000000 cur 387 last 0 00000020:00000080:0.0:1790945641.957417:0:14297:0:(genops.c:1384:class_connect()) connect: client 2ac65209-3704-434c-a055-442590f14168, cookie 0xc5cf2c2a6a5501e6 00000100:00080000:0.0:1790945641.957548:0:14297:0:(import.c:65:import_set_state_nolock()) ffff9bb741dae000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790945641.957625:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+5:3291:x1877942273658368:12345-0@lo:250:mount.lustre.0 Request processed in 273us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945641.957632:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790945641.957690:0:3291:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790945641.957699:0:3291:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.148@tcp: connect to target with instance 0 00000100:00080000:0.0:1790945641.957706:0:3291:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790945641.957710:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790945641.957713:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb86cae9000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790945641.957716:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790945641.957724:0:3291:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790945641.957730:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2ac65209-3704-434c-a055-442590f14168:3291:1877942273658368:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1790945641.959871:0:14286:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790945641.960077:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790945641.960084:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790945641.962578:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790945641.962589:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790945641.963470:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790945641.963478:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790945641.964813:0:14286:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790945641.964990:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790945641.964995:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790945641.965477:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790945641.965483:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790945642.007455:0:14286:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945642.007936:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790945642.007943:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790945642.009012:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790945642.009021:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790945642.010120:0:14286:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945642.010280:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790945642.010285:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1790945642.010805:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790945642.010812:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790945642.011329:0:14286:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945642.011460:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790945642.011465:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1790945642.012029:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790945642.012036:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790945642.012862:0:14286:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945642.013016:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790945642.013021:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1790945642.013476:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790945642.013487:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790945642.030333:0:14286:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790945642.030523:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790945642.030530:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1790945642.031870:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790945642.031881:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790945642.032649:0:14286:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790945642.032691:0:14286:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1790945642.033508:0:14286:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1790945642.033530:0:14286:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1790945642.033537:0:14286:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1790945642.033705:0:14286:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790945642.033740:0:14286:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.148@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1790945642.033745:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790945642.033746:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790945642.033747:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945642.033748:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945642.033750:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945642.033751:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945642.033752:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790945642.033754:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790945642.033755:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945642.033756:0:14286:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790945642.033759:0:14286:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1790945642.033760:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790945642.033762:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790945642.033763:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945642.033764:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945642.033765:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945642.033767:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945642.033768:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790945642.033769:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790945642.033770:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945642.033771:0:14286:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790945642.033798:0:14286:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790945642.033818:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273658496:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790945642.033902:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945642.033941:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb841254780 going to sleep for 11 seconds 00000100:00100000:2.0:1790945642.037238:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273658496 00000100:00100000:2.0:1790945642.037253:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273658496 00000100:00100000:2.0:1790945642.037318:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945642.037329:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+5:14286:x1877942273658496:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790945642.037390:0:14299:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790945642.037393:0:14299:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790945642.037396:0:14299:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1790945642.037787:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790945642.038171:0:14299:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1790945642.039065:0:14321:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1790945642.039071:0:14321:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1790945642.039074:0:14321:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1790945642.039109:0:14321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1790945642.039392:0:14299:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790945642.039402:0:14299:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790945642.044350:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+5:14286:x1877942273658496:12345-0@lo:253:mount.lustre.0 Request processed in 7015us (10440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945642.044365:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790945642.044444:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273658496:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790945642.044459:0:14286:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790945642.044462:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790945642.044464:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790945642.044465:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945642.044467:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945642.044468:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945642.044469:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945642.044471:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790945642.044472:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790945642.044474:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945642.044475:0:14286:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790945642.044493:0:14286:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bb87390c000 from lustre-MDT0000 10000000:01000000:0.0:1790945642.044522:0:14286:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1790945642.044525:0:14286:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790945642.044529:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bb87b5d0000 10000000:01000000:0.0:1790945642.044533:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790945642.044540:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bb87b5d0000 from 1 10000000:01000000:0.0:1790945642.044544:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790945642.044579:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c800/0xc5cf2c2a6a5501ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.044590:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c800/0xc5cf2c2a6a5501ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.044599:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c800/0xc5cf2c2a6a5501ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945642.044619:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273658624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790945642.044896:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945642.044965:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865fba9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945642.045002:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273658624 00000100:00100000:2.0:1790945642.045008:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273658624 00000100:00100000:2.0:1790945642.045141:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945642.045151:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+5:14286:x1877942273658624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790945642.045165:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945642.045186:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865430000/0xc5cf2c2a6a5501f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a5501ed expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.045210:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865430000/0xc5cf2c2a6a5501f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5501ed expref: 6 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.045221:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865430000/0xc5cf2c2a6a5501f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5501ed expref: 6 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.045243:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865430000, rc 0) 00000100:00100000:2.0:1790945642.045287:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+6:14286:x1877942273658624:12345-0@lo:101:mount.lustre.0 Request processed in 138us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945642.045293:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790945642.045353:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273658624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790945642.045367:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c800/0xc5cf2c2a6a5501ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5501f4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945642.045376:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c800/0xc5cf2c2a6a5501ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a5501f4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945642.045422:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273658752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790945642.045458:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945642.045625:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881b6e000 going to sleep for 11 seconds 00000100:00100000:0.0:1790945642.045847:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273658752 00000100:00100000:0.0:1790945642.045853:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273658752 00000100:00100000:0.0:1790945642.045875:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790945642.045881:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+6:14286:x1877942273658752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790945642.046116:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+6:14286:x1877942273658752:12345-0@lo:501:mount.lustre.0 Request processed in 235us (657us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790945642.046125:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790945642.046259:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273658752:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790945642.046284:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790945642.046303:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c800/0xc5cf2c2a6a5501ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5501f4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945642.046311:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c800/0xc5cf2c2a6a5501ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5501f4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945642.046319:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bb87390c000 10000000:01000000:1.0:1790945642.046324:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790945642.046328:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bb87390c000 10000000:01000000:1.0:1790945642.046330:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790945642.046333:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bb87390c000 from 1 10000000:01000000:1.0:1790945642.046336:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790945642.046355:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b133e00/0xc5cf2c2a6a5501fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945642.046362:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb87b133e00/0xc5cf2c2a6a5501fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945642.046370:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb87b133e00/0xc5cf2c2a6a5501fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945642.046383:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273658880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790945642.046409:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945642.046429:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881b6e000 going to sleep for 11 seconds 00000100:00100000:0.0:1790945642.046535:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273658880 00000100:00100000:0.0:1790945642.046540:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273658880 00000100:00100000:0.0:1790945642.046558:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790945642.046564:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+6:14286:x1877942273658880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790945642.046572:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945642.046583:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865d1d200/0xc5cf2c2a6a550202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a5501fb expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.046597:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1d200/0xc5cf2c2a6a550202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5501fb expref: 7 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.046606:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865d1d200/0xc5cf2c2a6a550202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5501fb expref: 7 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.046614:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d200, rc 0) 00000100:00100000:0.0:1790945642.046650:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+7:14286:x1877942273658880:12345-0@lo:101:mount.lustre.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945642.046678:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790945642.046747:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273658880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790945642.046766:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb87b133e00/0xc5cf2c2a6a5501fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550202 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945642.046774:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb87b133e00/0xc5cf2c2a6a5501fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a550202 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945642.046785:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790945642.046800:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b133e00/0xc5cf2c2a6a5501fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550202 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945642.046807:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb87b133e00/0xc5cf2c2a6a5501fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550202 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945642.046814:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790945642.046817:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790945642.046821:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bb87390c000 10000000:01000000:1.0:1790945642.046823:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790945642.046826:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790945642.046828:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790945642.046841:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b133000/0xc5cf2c2a6a550209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945642.046847:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb87b133000/0xc5cf2c2a6a550209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945642.046855:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb87b133000/0xc5cf2c2a6a550209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945642.046866:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273659008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790945642.046898:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945642.046916:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881b6e000 going to sleep for 11 seconds 00000100:00100000:2.0:1790945642.046967:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273659008 00000100:00100000:2.0:1790945642.046971:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273659008 00000100:00100000:2.0:1790945642.046990:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790945642.046997:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+7:14286:x1877942273659008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790945642.047003:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945642.047011:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865430400/0xc5cf2c2a6a550210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a550209 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.047023:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865430400/0xc5cf2c2a6a550210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550209 expref: 8 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.047031:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865430400/0xc5cf2c2a6a550210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550209 expref: 8 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.047037:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865430400, rc 0) 00000100:00100000:2.0:1790945642.047418:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+8:14286:x1877942273659008:12345-0@lo:101:mount.lustre.0 Request processed in 420us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945642.047433:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790945642.047496:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273659008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790945642.047506:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb87b133000/0xc5cf2c2a6a550209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550210 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945642.047513:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb87b133000/0xc5cf2c2a6a550209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a550210 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945642.047549:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273659136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790945642.047573:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945642.047625:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881b6e000 going to sleep for 11 seconds 00000100:00100000:3.0:1790945642.047683:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273659136 00000100:00100000:3.0:1790945642.047688:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273659136 00000100:00100000:0.0:1790945642.047761:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790945642.047774:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+8:14286:x1877942273659136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790945642.048319:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+9:14286:x1877942273659136:12345-0@lo:501:mount.lustre.0 Request processed in 545us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945642.048327:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790945642.048964:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273659136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790945642.049000:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273659264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790945642.051837:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945642.051898:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881b6e000 going to sleep for 11 seconds 00000100:00100000:0.0:1790945642.052784:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273659264 00000100:00100000:0.0:1790945642.052795:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273659264 00000100:00100000:0.0:1790945642.052839:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790945642.052847:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+9:14286:x1877942273659264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790945642.054316:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+9:14286:x1877942273659264:12345-0@lo:503:mount.lustre.0 Request processed in 1464us (5268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945642.054328:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790945642.058350:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273659264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790945642.063335:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe00a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ac65209-3704-434c-a055-442590f14168:14322:1877942273659392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945642.063427:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945642.063472:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb850e863c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945642.063588:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273659392 00000100:00100000:0.0:1790945642.063596:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273659392 00000100:00100000:0.0:1790945642.063634:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790945642.063642:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+9:14322:x1877942273659392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945642.063978:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+9:14322:x1877942273659392:12345-0@lo:502:llog_process_th.0 Request processed in 336us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945642.063986:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790945642.064531:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe00a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ac65209-3704-434c-a055-442590f14168:14322:1877942273659392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790945642.064565:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945642.064577:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.064579:0:14322:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790945642.064585:0:14322:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790945642.064589:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790945642.064603:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9bb865feb380) 00000020:00000080:3.0:1790945642.064627:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790945642.064633:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790945642.064786:0:14322:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790945642.064794:0:14322:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a55021e 00000020:00000080:3.0:1790945642.065002:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790945642.065006:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945642.065009:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.065011:0:14322:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790945642.065013:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945642.065017:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.065018:0:14322:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790945642.065021:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790945642.065027:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9bb865fe99c0) 00000020:00000080:3.0:1790945642.065037:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790945642.065142:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790945642.065145:0:14322:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790945642.065147:0:14322:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790945642.065153:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790945642.065200:0:14322:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb87390c000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790945642.065220:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9bb87b8419c0) 00000020:00000080:3.0:1790945642.065348:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790945642.065390:0:14322:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790945642.065395:0:14322:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5cf2c2a6a550233 00000020:00000080:3.0:1790945642.065480:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790945642.065486:0:14322:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790945642.065490:0:14322:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc5cf2c2a6a55023a 00080000:01000000:3.0:1790945642.065494:0:14322:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790945642.065497:0:14322:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a550241 00010000:00010000:2.0:1790945642.156024:0:14322:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790945642.156447:0:14322:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1790945642.156595:0:14322:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790945642.156976:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9bb87b5d19c0) 00000020:00000080:2.0:1790945642.156998:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790945642.157069:0:14322:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790945642.157076:0:14322:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a55024f 00000020:00000080:3.0:1790945642.161411:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790945642.166748:0:14322:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc5cf2c2a6a550256 00000020:00000080:3.0:1790945642.178702:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790945642.178718:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945642.178726:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.178728:0:14322:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790945642.178731:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945642.178738:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.178739:0:14322:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790945642.178743:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790945642.178786:0:14322:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790945642.178799:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945642.178802:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.178804:0:14322:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1790945642.178806:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790945642.178808:0:14322:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1790945642.178810:0:14322:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790945642.178811:0:14322:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790945642.178812:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790945642.178821:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.178823:0:14322:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790945642.178826:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790945642.178829:0:14322:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790945642.178833:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.178834:0:14322:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790945642.178837:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790945642.178842:0:14322:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:3.0:1790945642.178867:0:14322:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790945642.178870:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790945642.178884:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bb87b843380) 00000020:00000080:3.0:1790945642.178901:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1790945642.178907:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790945642.178969:0:14322:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790945642.178974:0:14322:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790945642.178981:0:14322:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a550264 00010000:00080000:3.0:1790945642.179012:0:14322:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb8818f6800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:3.0:1790945642.179228:0:14322:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1790945642.179615:0:14322:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790945642.179683:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790945642.180586:0:14322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790945642.180648:0:14322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1790945642.180774:0:14322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790945642.192952:0:14326:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790945642.192962:0:14326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790945642.194315:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790945642.194328:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790945642.194360:0:14322:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790945642.194378:0:14322:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5cf2c2a6a55026b 00000100:00080000:3.0:1790945642.194389:0:14322:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790945642.194400:0:14322:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bb8818f6800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1790945642.194436:0:14322:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87fe00a80 x1877942273659520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790945642.194479:0:14322:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790945642.194536:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945642.194540:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.194542:0:14322:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790945642.194545:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790945642.194548:0:14322:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1790945642.194550:0:14322:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790945642.194551:0:14322:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790945642.194553:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790945642.194555:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.194556:0:14322:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790945642.194559:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790945642.194563:0:14322:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790945642.194567:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.194569:0:14322:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790945642.194572:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790945642.194576:0:14322:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:3.0:1790945642.194598:0:14322:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790945642.194601:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790945642.194612:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bb87b844d40) 00000020:00000080:3.0:1790945642.194624:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1790945642.194629:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790945642.194710:0:14322:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790945642.194715:0:14322:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790945642.194721:0:14322:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc5cf2c2a6a550279 00010000:00080000:3.0:1790945642.194757:0:14322:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb865e73800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:3.0:1790945642.194942:0:14322:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1790945642.195131:0:14322:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790945642.195152:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790945642.195625:0:14322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790945642.195813:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273659520:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790945642.195867:0:3291:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942273659520 offset 0 length 520: 4 00000040:00080000:3.0:1790945642.197970:0:14322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1790945642.198108:0:14322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1790945642.201344:0:14328:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790945642.201353:0:14328:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790945642.202612:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790945642.202625:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790945642.202681:0:14322:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790945642.202702:0:14322:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5cf2c2a6a550280 00000100:00080000:3.0:1790945642.202712:0:14322:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790945642.202723:0:14322:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bb865e73800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1790945642.202759:0:14322:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87fe01180 x1877942273659648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790945642.202787:0:14322:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1790945642.202945:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273659648:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790945642.202996:0:3291:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942273659648 offset 0 length 520: 4 00000020:01000000:3.0:1790945642.203320:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945642.203325:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.203327:0:14322:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790945642.203330:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945642.203334:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.203335:0:14322:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790945642.203338:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790945642.203340:0:14322:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790945642.203342:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945642.203344:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.203345:0:14322:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790945642.203347:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790945642.203350:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.203351:0:14322:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790945642.203354:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790945642.203384:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ac65209-3704-434c-a055-442590f14168:14322:1877942273659776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945642.203438:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945642.203622:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273659776 00000100:00100000:2.0:1790945642.203629:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273659776 00000100:00100000:2.0:1790945642.203692:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790945642.203702:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+9:14322:x1877942273659776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945642.204274:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+9:14322:x1877942273659776:12345-0@lo:502:llog_process_th.0 Request processed in 572us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945642.204282:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790945642.204352:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945642.204372:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ac65209-3704-434c-a055-442590f14168:14322:1877942273659776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790945642.204394:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790945642.204404:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945642.204406:0:14322:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790945642.204410:0:14322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1790945642.204874:0:14286:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1790945642.204895:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790945642.204908:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b133000/0xc5cf2c2a6a550209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550210 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.204919:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb87b133000/0xc5cf2c2a6a550209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550210 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945642.204927:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bb87390c000 from 1 10000000:01000000:2.0:1790945642.204935:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790945642.204963:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.204971:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.204980:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945642.204996:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273659904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790945642.205031:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945642.205368:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc6540 going to sleep for 11 seconds 00000100:00100000:1.0:1790945642.205616:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273659904 00000100:00100000:1.0:1790945642.205623:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273659904 00000100:00100000:1.0:1790945642.205690:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790945642.205698:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+9:14286:x1877942273659904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790945642.205709:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945642.205724:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb87b132c00/0xc5cf2c2a6a55028e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a550287 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945642.205745:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb87b132c00/0xc5cf2c2a6a55028e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550287 expref: 10 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945642.205762:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb87b132c00/0xc5cf2c2a6a55028e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550287 expref: 10 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945642.205771:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b132c00, rc 0) 00000100:00100000:1.0:1790945642.205812:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+10:14286:x1877942273659904:12345-0@lo:101:mount.lustre.0 Request processed in 114us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945642.205818:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790945642.205903:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273659904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790945642.205918:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55028e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.205926:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a55028e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945642.206455:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273660032:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790945642.206493:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945642.206521:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc6540 going to sleep for 11 seconds 00000100:00100000:0.0:1790945642.206686:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273660032 00000100:00100000:0.0:1790945642.206692:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273660032 00000100:00100000:0.0:1790945642.206720:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790945642.206734:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+10:14286:x1877942273660032:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1790945642.206749:0:14297:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790945642.206755:0:14297:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1790945642.206824:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+10:14286:x1877942273660032:12345-0@lo:256:mount.lustre.0 Request processed in 91us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945642.206831:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790945642.207317:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273660032:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1790945642.208081:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790945642.208103:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55028e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.208164:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55028e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945642.208244:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb87390c000 from 1 10000000:01000000:0.0:1790945642.208247:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790945642.208276:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.208284:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.208293:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945642.208311:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273660160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790945642.208353:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945642.208386:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fa160c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945642.208429:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273660160 00000100:00100000:2.0:1790945642.208435:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273660160 00000100:00100000:2.0:1790945642.208470:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790945642.208476:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+10:14286:x1877942273660160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790945642.208487:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945642.208498:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865431200/0xc5cf2c2a6a55029c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a550295 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.208515:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865431200/0xc5cf2c2a6a55029c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550295 expref: 11 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.208525:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865431200/0xc5cf2c2a6a55029c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550295 expref: 11 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.208534:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431200, rc 0) 00000100:00100000:2.0:1790945642.208570:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+11:14286:x1877942273660160:12345-0@lo:101:mount.lustre.0 Request processed in 94us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945642.208577:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790945642.208696:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273660160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790945642.208709:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55029c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.208717:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a55029c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945642.208762:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273660288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790945642.208798:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945642.208814:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fa160c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945642.208950:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273660288 00000100:00100000:2.0:1790945642.208954:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273660288 00000100:00100000:2.0:1790945642.208980:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790945642.208986:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb85109a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+11:14286:x1877942273660288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790945642.209352:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb85109a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+11:14286:x1877942273660288:12345-0@lo:501:mount.lustre.0 Request processed in 364us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945642.209368:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790945642.211842:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273660288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790945642.211901:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273660416:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790945642.211971:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945642.212068:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881b6ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945642.214602:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273660416 00000100:00100000:3.0:1790945642.214616:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273660416 00000100:00100000:3.0:1790945642.214703:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790945642.214714:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+11:14286:x1877942273660416:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790945642.214952:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+11:14286:x1877942273660416:12345-0@lo:503:mount.lustre.0 Request processed in 240us (2980us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945642.214961:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790945642.215243:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273660416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790945642.215620:0:14330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ac65209-3704-434c-a055-442590f14168:14330:1877942273660544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945642.215842:0:14330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945642.215868:0:14330:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865dc6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945642.215920:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273660544 00000100:00100000:0.0:1790945642.215925:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273660544 00000100:00100000:0.0:1790945642.215961:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790945642.215969:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+11:14330:x1877942273660544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945642.216191:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+11:14330:x1877942273660544:12345-0@lo:502:llog_process_th.0 Request processed in 222us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945642.216198:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790945642.216336:0:14330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ac65209-3704-434c-a055-442590f14168:14330:1877942273660544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945642.216361:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945642.216371:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945642.216373:0:14330:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790945642.216382:0:14330:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb87390c000 00000020:00000080:2.0:1790945642.216385:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790945642.216393:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945642.216396:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945642.216397:0:14330:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790945642.216400:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945642.216402:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945642.216403:0:14330:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790945642.216407:0:14330:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb87390c000 00000020:00000080:2.0:1790945642.216408:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790945642.216458:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945642.216461:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945642.216462:0:14330:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790945642.216464:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945642.216466:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945642.216468:0:14330:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790945642.216471:0:14330:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bb87390c000 00000020:00000080:2.0:1790945642.216473:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790945642.216504:0:14330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ac65209-3704-434c-a055-442590f14168:14330:1877942273660672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790945642.216536:0:14330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945642.216559:0:14330:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85209d780 going to sleep for 11 seconds 00000100:00100000:3.0:1790945642.216610:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273660672 00000100:00100000:3.0:1790945642.216615:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273660672 00000100:00100000:3.0:1790945642.216642:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790945642.216649:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+11:14330:x1877942273660672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945642.216791:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+11:14330:x1877942273660672:12345-0@lo:502:llog_process_th.0 Request processed in 142us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945642.216798:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790945642.216861:0:14330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ac65209-3704-434c-a055-442590f14168:14330:1877942273660672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790945642.216877:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945642.216881:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945642.216882:0:14330:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790945642.216886:0:14330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790945642.217011:0:14286:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790945642.217031:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790945642.217062:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55029c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945642.217074:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55029c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945642.217114:0:14286:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790945642.217117:0:14286:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bb87390c000 10000000:01000000:3.0:1790945642.217120:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bb87390c000 10000000:01000000:3.0:1790945642.217124:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790945642.217134:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bb87390c000 from 1 10000000:01000000:3.0:1790945642.217137:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790945642.217159:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a5502a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945642.217167:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a5502a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945642.217175:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a5502a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945642.217187:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273660800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790945642.217215:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945642.217236:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345e900 going to sleep for 11 seconds 00000100:00100000:3.0:1790945642.217249:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273660800 00000100:00100000:3.0:1790945642.217253:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273660800 00000100:00100000:3.0:1790945642.217276:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790945642.217282:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb85109bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+11:14286:x1877942273660800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790945642.217291:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945642.217305:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8821c4800/0xc5cf2c2a6a5502aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a5502a3 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945642.217325:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c4800/0xc5cf2c2a6a5502aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5502a3 expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945642.217335:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8821c4800/0xc5cf2c2a6a5502aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5502a3 expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945642.217344:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4800, rc 0) 00000100:00100000:3.0:1790945642.217373:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb85109bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14286:x1877942273660800:12345-0@lo:101:mount.lustre.0 Request processed in 91us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945642.217385:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790945642.217418:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273660800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790945642.217429:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a5502a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5502aa expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945642.217437:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a5502a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a5502aa expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945642.217476:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273660928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790945642.217499:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945642.217518:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345e900 going to sleep for 11 seconds 00000100:00100000:3.0:1790945642.217529:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273660928 00000100:00100000:3.0:1790945642.217532:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273660928 00000100:00100000:3.0:1790945642.217554:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790945642.217559:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14286:x1877942273660928:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790945642.217782:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14286:x1877942273660928:12345-0@lo:501:mount.lustre.0 Request processed in 222us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945642.217789:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790945642.217820:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273660928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790945642.217845:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273661056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790945642.217877:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945642.217895:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84345e900 going to sleep for 11 seconds 00000100:00100000:3.0:1790945642.217908:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273661056 00000100:00100000:3.0:1790945642.217912:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273661056 00000100:00100000:3.0:1790945642.217933:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790945642.217945:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14286:x1877942273661056:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790945642.218086:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14286:x1877942273661056:12345-0@lo:503:mount.lustre.0 Request processed in 141us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945642.218092:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790945642.218131:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273661056:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790945642.222408:0:14331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b374000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ac65209-3704-434c-a055-442590f14168:14331:1877942273661184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945642.222489:0:14331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945642.222527:0:14331:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fa16600 going to sleep for 11 seconds 00000100:00100000:3.0:1790945642.225284:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273661184 00000100:00100000:3.0:1790945642.225300:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273661184 00000100:00100000:3.0:1790945642.225355:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790945642.225365:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14331:x1877942273661184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790945642.225640:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14331:x1877942273661184:12345-0@lo:502:llog_process_th.0 Request processed in 276us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945642.225648:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790945642.225793:0:14331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b374000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ac65209-3704-434c-a055-442590f14168:14331:1877942273661184:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1790945642.225861:0:14331:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1790945642.225876:0:14331:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9bb8656099c0) 00000020:00000080:0.0:1790945642.225899:0:14331:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1790945642.225986:0:14331:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb87390c000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790945642.225990:0:14331:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb87390c000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790945642.225993:0:14331:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bb87390c000 4 00010000:00080000:0.0:1790945642.226023:0:14331:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb8654d7800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:0.0:1790945642.227639:0:14331:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1790945642.227852:0:14331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1790945642.227881:0:14331:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790945642.227895:0:14331:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc5cf2c2a6a5502b8 00000100:00080000:0.0:1790945642.227903:0:14331:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790945642.227912:0:14331:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bb8654d7800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1790945642.227941:0:14331:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87b374000 x1877942273661312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790945642.227989:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1877942273661312:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790945642.228054:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790945642.228112:0:14331:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790945642.228135:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790945642.228139:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790945642.228142:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790945642.228144:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790945642.228901:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273661312 00000100:00100000:3.0:1790945642.228911:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273661312 00000100:00100000:3.0:1790945642.228939:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790945642.228946:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1877942273661312:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790945642.229008:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1877942273661312:12345-0@lo:38:llog_process_th.0 Request processed in 62us (966us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790945642.229015:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790945642.229071:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790945642.229079:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb8654d7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790945642.229082:0:3291:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790945642.229086:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1877942273661312:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790945642.231620:0:14331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ac65209-3704-434c-a055-442590f14168:14331:1877942273661440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790945642.231722:0:14331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945642.231760:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273661440 00000100:00100000:0.0:1790945642.231767:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273661440 00000100:00100000:0.0:1790945642.231808:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790945642.231817:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+12:14331:x1877942273661440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790945642.241195:0:14331:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fa16840 going to sleep for 11 seconds 00000100:00100000:0.0:1790945642.241280:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+12:14331:x1877942273661440:12345-0@lo:502:llog_process_th.0 Request processed in 9458us (9553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945642.241293:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790945642.243718:0:14331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ac65209-3704-434c-a055-442590f14168:14331:1877942273661440:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790945642.243788:0:14331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790945642.250606:0:14286:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1790945642.250644:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790945642.250702:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a5502a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5502aa expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.250716:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5200/0xc5cf2c2a6a5502a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5502aa expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790945642.250785:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790945642.250788:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790945642.250789:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945642.250790:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945642.250791:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945642.250793:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945642.250794:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790945642.250795:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790945642.250797:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945642.250798:0:14286:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790945642.250801:0:14286:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1790945642.250804:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790945642.250805:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790945642.250806:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945642.250807:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945642.250808:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945642.250810:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945642.250811:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790945642.250812:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790945642.250813:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945642.250814:0:14286:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790945642.250840:0:14286:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790945642.250860:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273661568:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790945642.250937:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945642.250977:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843851c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945642.251001:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273661568 00000100:00100000:0.0:1790945642.251008:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273661568 00000100:00100000:0.0:1790945642.251060:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790945642.251069:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14286:x1877942273661568:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790945642.251096:0:14299:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790945642.251109:0:14299:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790945642.338751:0:14299:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790945642.338798:0:14299:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1790945642.339645:0:14320:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790945642.339651:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790945642.340052:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.340071:0:14320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb87b132c00/0xc5cf2c2a6a55028e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550287 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.340081:0:14320:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.340122:0:14320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb87b132c00/0xc5cf2c2a6a55028e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a550287 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.340139:0:14320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb87b132c00/0xc5cf2c2a6a55028e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a550287 expref: 12 pid: 14298 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945642.340334:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b374000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1877942273661696:0@lo:104: 00000100:00100000:0.0:1790945642.340404:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945642.340495:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb873895480 going to sleep for 11 seconds 00000100:00100000:1.0:1790945642.340565:0:14287:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273661696 00000100:00100000:1.0:1790945642.340573:0:14287:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273661696 00000100:00100000:1.0:1790945642.340740:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790945642.340752:0:14287:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2ac65209-3704-434c-a055-442590f14168+3:14320:x1877942273661696:12345-0@lo:104: 00010000:00010000:1.0:1790945642.340765:0:14287:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a55028e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945642.340902:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b374000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1877942273661696:0@lo:104: 00010000:00010000:1.0:1790945642.340920:0:14287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1790945642.340924:0:14320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945642.340938:0:14287:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2ac65209-3704-434c-a055-442590f14168+3:14320:x1877942273661696:12345-0@lo:104: Request processed in 188us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945642.340960:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790945642.341084:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945642.341091:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a55028e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.341100:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865430e00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1790945642.341104:0:14293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a55028e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.341113:0:14293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a55028e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790945642.341122:0:14293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a55028e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790945642.341140:0:14293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790945642.341500:0:14293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a55028e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.341509:0:14293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790945642.341584:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ac65209-3704-434c-a055-442590f14168:3294:1877942273661824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790945642.341619:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945642.341695:0:14289:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273661824 00000100:00100000:2.0:1790945642.341701:0:14289:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273661824 00010000:00010000:2.0:1790945642.341724:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb87b132c00/0xc5cf2c2a6a55028e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a550287 expref: 13 pid: 14298 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.341727:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a55028e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.341744:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb865430e00/0xc5cf2c2a6a550287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a55028e expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945642.341760:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790945642.341762:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945642.341765:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945642.341768:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945642.341772:0:14289:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ac65209-3704-434c-a055-442590f14168+13:3294:x1877942273661824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945642.341784:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945642.341789:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb87b132c00/0xc5cf2c2a6a55028e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a550287 expref: 13 pid: 14298 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.341814:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb87b132c00/0xc5cf2c2a6a55028e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a550287 expref: 13 pid: 14298 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.341828:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb87b132c00/0xc5cf2c2a6a55028e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a550287 expref: 13 pid: 14298 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.341840:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.341848:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790945642.341861:0:14289:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002209777s 00010000:00010000:2.0:1790945642.341871:0:14289:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.341879:0:14289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.341886:0:14289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.341893:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.341899:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945642.341903:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.341910:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.341927:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945642.341945:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945642.341956:0:14320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.341966:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945642.341973:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865d1d400/0xc5cf2c2a6a5502bf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945642.341986:0:14289:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ac65209-3704-434c-a055-442590f14168+12:3294:x1877942273661824:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945642.341994:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790945642.342052:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ac65209-3704-434c-a055-442590f14168:3294:1877942273661824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945642.345461:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+11:14286:x1877942273661568:12345-0@lo:253:mount.lustre.0 Request processed in 94384us (94515us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945642.345477:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790945642.345481:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14286:1877942273661568:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790945642.345499:0:14286:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790945642.345502:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790945642.345504:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790945642.345506:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945642.345507:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945642.345509:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945642.345523:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945642.345524:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790945642.345526:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790945642.345528:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945642.345529:0:14286:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790945642.345542:0:14286:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790945642.350551:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1790945642.350754:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790945642.351382:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1790945642.351535:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790945642.352039:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1790945642.352210:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1790945642.353251:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1790945642.353413:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1790945642.353705:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790945642.354317:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790945642.354595:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1790945642.354783:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1790945642.382421:0:14286:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1790945642.382773:0:14286:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1790945642.383244:0:14344:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1790945642.383307:0:14344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1790945642.385875:0:14286:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790945642.386155:0:14286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790945642.386889:0:14286:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790945642.386899:0:14286:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790945642.392358:0:14286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790945642.393312:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790945642.393381:0:14344:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790945642.393385:0:14344:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:3.0:1790945642.395482:0:14343:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1790945642.395490:0:14343:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1790945642.396241:0:14286:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790945642.396953:0:14286:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790945642.396991:0:14286:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1790945642.401025:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1790945642.406322:0:14286:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1790945642.443840:0:14286:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790945642.443887:0:14286:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6b441c83988 00100000:10000000:0.0:1790945642.443895:0:14286:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790945642.444459:0:14286:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790945642.444476:0:14286:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790945642.444488:0:14286:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1790945642.444515:0:14286:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1790945642.971995:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790945643.293158:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1790945643.547753:0:14301:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790945643.547759:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bb87390c000 from 6 10000000:01000000:3.0:1790945643.547763:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790945643.548089:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945643.548102:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945643.548113:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945643.548140:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273661952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790945643.548213:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945643.548292:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fb1e180 going to sleep for 11 seconds 00000100:00100000:0.0:1790945643.548371:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273661952 00000100:00100000:0.0:1790945643.548378:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273661952 00000100:00100000:0.0:1790945643.548426:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790945643.548435:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+11:14301:x1877942273661952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945643.548449:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945643.548463:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865d1d800/0xc5cf2c2a6a5502cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a5502c6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945643.548485:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1d800/0xc5cf2c2a6a5502cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5502c6 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945643.548505:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865d1d800/0xc5cf2c2a6a5502cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5502c6 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945643.548512:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d800, rc 0) 00000100:00100000:0.0:1790945643.548551:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+12:14301:x1877942273661952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945643.548556:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790945643.549105:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273661952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945643.549120:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5502cd expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945643.549130:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a5502cd expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945643.549191:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273662080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790945643.549350:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945643.549385:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fb1e180 going to sleep for 11 seconds 00000100:00100000:2.0:1790945643.549503:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273662080 00000100:00100000:2.0:1790945643.549509:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273662080 00000100:00100000:2.0:1790945643.549547:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790945643.549554:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14301:x1877942273662080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790945643.549570:0:14299:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790945643.549587:0:14299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790945643.549590:0:14299:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1790945643.549959:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14301:x1877942273662080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 404us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945643.549967:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790945643.550120:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273662080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790945643.550334:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790945643.550342:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5502cd expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945643.550352:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5502cd expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945643.997497:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790945644.323471:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790945645.020009:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945646.044246:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790945646.444073:0:14587:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790945647.069130:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790945647.388089:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790945647.388096:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790945647.388098:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790945647.388101:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790945647.388103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790945647.388107:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790945647.388110:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bb8654d7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790945647.388127:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bb8654d7800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1790945647.388150:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87b375f80 x1877942273662336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790945647.388215:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1877942273662336:0@lo:38:kworker.0 00000100:00100000:1.0:1790945647.388317:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945647.388329:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ac65209-3704-434c-a055-442590f14168:3294:1877942273662208:0@lo:400:kworker.0 00000100:00100000:1.0:1790945647.388394:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945647.388450:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273662208 00000100:00100000:1.0:1790945647.388457:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273662208 00000100:00100000:1.0:1790945647.388492:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790945647.388500:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+12:3294:x1877942273662208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945647.388546:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+12:3294:x1877942273662208:12345-0@lo:400:kworker.0 Request processed in 46us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945647.388554:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790945647.388597:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ac65209-3704-434c-a055-442590f14168:3294:1877942273662208:0@lo:400:kworker.0 00000100:00100000:0.0:1790945647.388741:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945647.390472:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273662336 00000100:00100000:1.0:1790945647.390483:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273662336 00000100:00100000:1.0:1790945647.390522:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790945647.390529:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3291:x1877942273662336:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790945647.390555:0:14306:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 393 last 0 00000020:00000080:1.0:1790945647.390592:0:14306:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc5cf2c2a6a5502d4 00000004:00100000:1.0:1790945647.390607:0:14306:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790945647.390764:0:14306:0:(import.c:65:import_set_state_nolock()) ffff9bb87b4ba800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790945647.390835:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1877942273662336:12345-0@lo:38:kworker.0 Request processed in 304us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945647.390842:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790945647.390897:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bb87b375f80 x1877942273662336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790945657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790945647.390913:0:3291:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790945647.390920:0:3291:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790945647.390925:0:3291:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790945647.390927:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb8654d7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790945647.390932:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3291:1877942273662336:0@lo:38:kworker.0 00010000:00010000:0.0:1790945648.098452:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945649.117888:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790945649.342294:0:14737:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd9d816d0 20000000:00000080:1.0:1790945649.342320:0:14737:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb87e310400 uarg=0000000000000000 20000000:01000000:1.0:1790945649.342358:0:14737:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790945649.342370:0:14737:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790945649.342375:0:14737:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790945649.344393:0:14738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1790945649.344483:0:14737:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790945649.350719:0:14737:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790945649.350934:0:14737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945649.350970:0:14737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb865431200/0xc5cf2c2a6a55029c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550295 expref: 11 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945649.350990:0:14737:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945649.351033:0:14737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb865431200/0xc5cf2c2a6a55029c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a550295 expref: 11 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945649.351047:0:14737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb865431200/0xc5cf2c2a6a55029c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a550295 expref: 11 pid: 14297 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945649.351062:0:14737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14737:1877942273662464:0@lo:104: 00000100:00100000:1.0:1790945649.351131:0:14737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945649.351183:0:14737:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb881b6e600 going to sleep for 11 seconds 00000100:00100000:3.0:1790945649.351253:0:14288:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273662464 00000100:00100000:3.0:1790945649.351262:0:14288:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273662464 00000100:00100000:3.0:1790945649.351313:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945649.351323:0:14288:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b378e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ac65209-3704-434c-a055-442590f14168+3:14737:x1877942273662464:12345-0@lo:104: 00010000:00010000:3.0:1790945649.351342:0:14288:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a55029c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945649.351418:0:14288:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790945649.351431:0:14288:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b378e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ac65209-3704-434c-a055-442590f14168+3:14737:x1877942273662464:12345-0@lo:104: Request processed in 111us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945649.351438:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790945649.351461:0:14737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14737:1877942273662464:0@lo:104: 00010000:00010000:2.0:1790945649.351534:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945649.351546:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a55029c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.351554:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d000 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945649.351558:0:14293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a55029c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945649.351560:0:14737:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.351567:0:14293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a55029c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945649.351574:0:14293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a55029c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945649.351586:0:14293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790945649.351619:0:14293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a55029c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.351625:0:14293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945649.351674:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a55029c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.351683:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb865d1d000/0xc5cf2c2a6a550295 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a55029c expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.351699:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945649.351701:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945649.351702:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945649.351716:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273662592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945649.351747:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945649.351961:0:14289:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273662592 00000100:00100000:2.0:1790945649.351966:0:14289:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273662592 00010000:00010000:2.0:1790945649.351998:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb865431200/0xc5cf2c2a6a55029c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a550295 expref: 12 pid: 14297 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945649.352019:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945649.352025:0:14289:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b375c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ac65209-3704-434c-a055-442590f14168+12:3292:x1877942273662592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945649.352035:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945649.352040:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb865431200/0xc5cf2c2a6a55029c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a550295 expref: 12 pid: 14297 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.352050:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb865431200/0xc5cf2c2a6a55029c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a550295 expref: 12 pid: 14297 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.352063:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865431200/0xc5cf2c2a6a55029c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a550295 expref: 12 pid: 14297 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.352080:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.352088:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.352101:0:14289:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.352108:0:14289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.352114:0:14289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.352120:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.352125:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132200 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945649.352128:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.352135:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.352148:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945649.352156:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945649.352187:0:14289:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b375c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ac65209-3704-434c-a055-442590f14168+11:3292:x1877942273662592:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945649.352199:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945649.352229:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273662592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790945649.352714:0:14737:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945649.352724:0:14737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945649.352730:0:14737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb87b132200/0xc5cf2c2a6a5502db lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945650.141737:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790945650.719220:0:14301:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790945650.719228:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb87390c000 from 10 10000000:01000000:3.0:1790945650.719236:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790945650.719297:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945650.724199:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945650.724216:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945650.724246:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273662720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790945650.726270:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945650.726527:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273662720 00000100:00100000:2.0:1790945650.726538:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273662720 00000100:00100000:2.0:1790945650.726600:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790945650.726610:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+11:14301:x1877942273662720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945650.726628:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945650.726649:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865431600/0xc5cf2c2a6a5502e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a5502e2 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945650.726703:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865431600/0xc5cf2c2a6a5502e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5502e2 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945650.726704:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb847da73c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790945650.726718:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865431600/0xc5cf2c2a6a5502e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5502e2 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945650.726729:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431600, rc 0) 00000100:00100000:2.0:1790945650.726909:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+12:14301:x1877942273662720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 300us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945650.726917:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790945650.727499:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273662720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945650.727519:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5502e9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945650.727528:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a5502e9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945650.727597:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273662848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945650.727632:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945650.727686:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb847da73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945650.728591:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273662848 00000100:00100000:2.0:1790945650.728601:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273662848 00000100:00100000:2.0:1790945650.728653:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790945650.728680:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14301:x1877942273662848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945650.729145:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14301:x1877942273662848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 465us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945650.729157:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790945650.739029:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273662848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790945650.739374:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273662976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945650.739859:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945650.742750:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fb1e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945650.746853:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273662976 00000100:00100000:0.0:1790945650.746875:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273662976 00000100:00100000:1.0:1790945650.754071:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790945650.754105:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+12:14301:x1877942273662976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790945650.754498:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+12:14301:x1877942273662976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 413us (14639us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945650.754508:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790945650.754546:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273662976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790945650.756724:0:14803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790945650.760393:0:14301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790945650.760494:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790945650.760507:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5502e9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945650.760520:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5502e9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945651.163915:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945652.188114:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790945652.508551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1790945652.508552:0:3291:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790945642/real 1790945642] req@ffff9bb87fe01180 x1877942273659648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790945652 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790945652.508558:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790945652.508576:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790945652.508579:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790945652.508583:0:3291:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bb87fe01180 x1877942273659648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790945652 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945652.508593:0:3291:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790945642/real 1790945642] req@ffff9bb87fe00a80 x1877942273659520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790945652 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945652.508604:0:3291:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bb87fe00a80 x1877942273659520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790945652 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790945652.508623:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb865e73800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790945652.508648:0:3291:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790945652.508652:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273659648:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790945652.508681:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb8818f6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790945652.508686:0:3291:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790945652.508689:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273659520:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790945652.508712:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790945652.508715:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790945652.508717:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bb8818f6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790945652.508721:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 387 00000100:00080000:0.0:1790945652.508727:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790945652.508736:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bb8818f6800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1790945652.508754:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87b376680 x1877942273663360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790945652.508767:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790945652.508770:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790945652.508771:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bb865e73800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790945652.508774:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 387 00000100:00080000:0.0:1790945652.508776:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790945652.508780:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bb865e73800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1790945652.508790:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87b374e00 x1877942273663488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790945652.508809:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273663360:0@lo:8:kworker.0 00000400:00000100:0.0:1790945652.508851:0:3291:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942273663360 offset 0 length 520: 4 00000100:00100000:0.0:1790945652.508889:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273663488:0@lo:8:kworker.0 00000400:00000100:0.0:1790945652.508905:0:3291:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877942273663488 offset 0 length 520: 4 00000100:00100000:2.0:1790945652.509598:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ac65209-3704-434c-a055-442590f14168:3293:1877942273663104:0@lo:400:kworker.0 00000100:00100000:2.0:1790945652.509673:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945652.509703:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790945652.509711:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273663232:0@lo:400:kworker.0 00000100:00100000:2.0:1790945652.509739:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945652.509766:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273663104 00000100:00100000:2.0:1790945652.509774:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273663104 00000100:00100000:2.0:1790945652.509816:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790945652.509825:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+12:3293:x1877942273663104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945652.509870:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+12:3293:x1877942273663104:12345-0@lo:400:kworker.0 Request processed in 45us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945652.509877:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790945652.509927:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273663232 00000100:00100000:2.0:1790945652.509931:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273663232 00000100:00100000:2.0:1790945652.509972:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945652.509978:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273663232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945652.510014:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273663232:12345-0@lo:400:kworker.0 Request processed in 36us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945652.510020:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945652.510051:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ac65209-3704-434c-a055-442590f14168:3293:1877942273663104:0@lo:400:kworker.0 00010000:00080000:2.0:1790945652.510077:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bb87fe03480 x1877942273663232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945652.510088:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273663232:0@lo:400:kworker.0 00010000:00010000:2.0:1790945653.218244:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945654.235977:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790945654.241321:0:14986:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790945654.241325:0:14986:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1790945654.241462:0:14986:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bb8654d2800 00000020:01000004:0.0:1790945654.241478:0:14986:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790945654.241491:0:14986:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790945654.241505:0:14986:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bb865608000) 00000020:00000080:0.0:1790945654.241527:0:14986:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790945654.304947:0:14986:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790945654.311984:0:14986:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790945654.313102:0:14986:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790945654.316899:0:14986:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1790945654.318094:0:14986:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790945654.318606:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 640: rc = 0 00100000:10000000:3.0:1790945654.318739:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 640: rc = 0 00100000:10000000:3.0:1790945654.318838:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 640: rc = 0 00100000:10000000:3.0:1790945654.320606:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 779: rc = 0 00100000:10000000:3.0:1790945654.323653:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 779: rc = 0 00100000:10000000:3.0:1790945654.323993:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 779: rc = 0 00100000:10000000:3.0:1790945654.324576:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 779: rc = 0 00100000:10000000:3.0:1790945654.329010:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 779: rc = 0 00100000:10000000:3.0:1790945654.330622:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 779: rc = 0 00000020:00000080:3.0:1790945654.335412:0:14986:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1790945654.335428:0:14986:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790945654.335439:0:14986:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc5cf2c2a6a5502f7 00000020:01000004:3.0:1790945654.335447:0:14986:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1790945654.335467:0:14986:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790945654.335470:0:14986:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790945654.335476:0:14986:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1790945654.335481:0:14986:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1790945654.335493:0:14986:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bb87b840000) 00000020:00000080:3.0:1790945654.335504:0:14986:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1790945654.339387:0:14986:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790945654.339596:0:14986:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1790945654.339603:0:14986:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790945654.348795:0:14986:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790945654.350831:0:14986:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790945654.352946:0:14986:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790945654.352959:0:14986:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790945654.354753:0:14986:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790945654.355329:0:14986:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790945654.355336:0:14986:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790945654.356133:0:14986:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790945654.356141:0:14986:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1790945654.378796:0:14986:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790945654.379049:0:14986:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790945654.379056:0:14986:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1790945654.380612:0:14986:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790945654.380624:0:14986:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1790945654.381957:0:14986:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790945654.381968:0:14986:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1790945654.383960:0:14986:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790945654.384396:0:14986:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1790945654.384402:0:14986:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1790945654.385340:0:14986:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1790945654.385348:0:14986:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1790945654.423010:0:14986:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790945654.423407:0:14986:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1790945654.423414:0:14986:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1790945654.424843:0:14986:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1790945654.424854:0:14986:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1790945654.425534:0:14986:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1790945654.425557:0:14986:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1790945654.425564:0:14986:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1790945654.444440:0:14986:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790945654.444487:0:14986:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.148@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1790945654.444492:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790945654.444494:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790945654.444495:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945654.444497:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945654.444503:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945654.444505:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945654.444506:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790945654.444508:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945654.444509:0:14986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790945654.444514:0:14986:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1790945654.444516:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790945654.444517:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790945654.444517:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945654.444518:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945654.444519:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945654.444520:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945654.444521:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790945654.444522:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945654.444523:0:14986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790945654.444562:0:14986:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790945654.444586:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273663616:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790945654.444795:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945654.444911:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d480c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945654.445369:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273663616 00000100:00100000:2.0:1790945654.445378:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273663616 00000100:00100000:2.0:1790945654.445486:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790945654.445497:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+12:14986:x1877942273663616:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790945654.445527:0:14298:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790945654.445530:0:14298:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1790945654.445534:0:14298:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1790945654.469400:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+12:14986:x1877942273663616:12345-0@lo:253:mount.lustre.0 Request processed in 23896us (24735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945654.469415:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790945654.469524:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273663616:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790945654.469539:0:14986:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790945654.469542:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790945654.469544:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790945654.469546:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790945654.469547:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790945654.469549:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790945654.469550:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790945654.469552:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790945654.469554:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790945654.469555:0:14986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790945654.469576:0:14986:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bb8654d2800 from lustre-OST0000 10000000:01000000:1.0:1790945654.469604:0:14986:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790945654.469606:0:14986:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790945654.469613:0:14986:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bb87b5d0000 local copy 00010000:00010000:1.0:1790945654.469624:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c800/0xc5cf2c2a6a5501ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5501f4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945654.469899:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273663744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790945654.469949:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945654.469988:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945654.470084:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273663744 00000100:00100000:2.0:1790945654.470091:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273663744 00000100:00100000:2.0:1790945654.470140:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790945654.470149:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14986:x1877942273663744:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790945654.470511:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+12:14986:x1877942273663744:12345-0@lo:501:mount.lustre.0 Request processed in 361us (561us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790945654.470518:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790945654.470810:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273663744:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790945654.470828:0:14986:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790945654.470989:0:14986:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790945654.470997:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c800/0xc5cf2c2a6a5501ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5501f4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.471007:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c800/0xc5cf2c2a6a5501ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5501f4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945654.471025:0:14986:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bb8654d2800 10000000:01000000:1.0:1790945654.471030:0:14986:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790945654.471034:0:14986:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bb87b5d0000 10000000:01000000:1.0:1790945654.471036:0:14986:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790945654.471040:0:14986:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9bb87b5d0000 from 1 10000000:01000000:1.0:1790945654.471043:0:14986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790945654.471066:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b133400/0xc5cf2c2a6a550305 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.471074:0:14986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb87b133400/0xc5cf2c2a6a550305 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.471083:0:14986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb87b133400/0xc5cf2c2a6a550305 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945654.471947:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273663872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790945654.472002:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945654.472044:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945654.472371:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273663872 00000100:00100000:2.0:1790945654.472378:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273663872 00000100:00100000:2.0:1790945654.472424:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790945654.472431:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+12:14986:x1877942273663872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790945654.472444:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945654.472460:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865430800/0xc5cf2c2a6a55030c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a550305 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.472495:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865430800/0xc5cf2c2a6a55030c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550305 expref: 13 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.472504:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865430800/0xc5cf2c2a6a55030c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550305 expref: 13 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.472513:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865430800, rc 0) 00000100:00100000:2.0:1790945654.472553:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+13:14986:x1877942273663872:12345-0@lo:101:mount.lustre.0 Request processed in 122us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945654.472560:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790945654.472690:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273663872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790945654.472705:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb87b133400/0xc5cf2c2a6a550305 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55030c expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.472712:0:14986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb87b133400/0xc5cf2c2a6a550305 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a55030c expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945654.472730:0:14986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790945654.472746:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b133400/0xc5cf2c2a6a550305 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55030c expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.472754:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb87b133400/0xc5cf2c2a6a550305 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55030c expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945654.472761:0:14986:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790945654.472766:0:14986:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790945654.472771:0:14986:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1790945654.472773:0:14986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790945654.472790:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b133a00/0xc5cf2c2a6a550313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.472797:0:14986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb87b133a00/0xc5cf2c2a6a550313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.472804:0:14986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb87b133a00/0xc5cf2c2a6a550313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945654.472826:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790945654.472850:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945654.472881:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945654.473080:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273664000 00000100:00100000:3.0:1790945654.473085:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273664000 00000100:00100000:3.0:1790945654.473125:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790945654.473132:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+13:14986:x1877942273664000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790945654.473140:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945654.473150:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a55031a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a550313 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945654.473175:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a55031a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550313 expref: 14 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945654.473184:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8821c4600/0xc5cf2c2a6a55031a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550313 expref: 14 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945654.473190:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c4600, rc 0) 00000100:00100000:3.0:1790945654.473229:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+14:14986:x1877942273664000:12345-0@lo:101:mount.lustre.0 Request processed in 98us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945654.473235:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790945654.473418:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790945654.473431:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb87b133a00/0xc5cf2c2a6a550313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55031a expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.473439:0:14986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb87b133a00/0xc5cf2c2a6a550313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a55031a expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790945654.474205:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1790945654.475039:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790945654.475295:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1790945654.475342:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1790945654.475379:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1790945654.475427:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1790945654.475466:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1790945654.475500:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1790945654.475568:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1790945654.475576:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1790945654.475651:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790945654.475751:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945654.475795:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48840 going to sleep for 11 seconds 00000100:00100000:2.0:1790945654.476328:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273664128 00000100:00100000:2.0:1790945654.476337:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273664128 00000100:00100000:2.0:1790945654.476392:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790945654.476402:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+14:14986:x1877942273664128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790945654.476806:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+14:14986:x1877942273664128:12345-0@lo:501:mount.lustre.0 Request processed in 404us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945654.476815:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790945654.478911:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790945654.478989:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790945654.479067:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945654.479122:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48840 going to sleep for 11 seconds 00000100:00100000:2.0:1790945654.479626:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273664256 00000100:00100000:2.0:1790945654.479634:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273664256 00000100:00100000:2.0:1790945654.479719:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790945654.479729:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+14:14986:x1877942273664256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790945654.484407:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+14:14986:x1877942273664256:12345-0@lo:503:mount.lustre.0 Request processed in 4671us (5330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945654.484424:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790945654.485622:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664256:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790945654.488047:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790945654.488152:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790945654.488309:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945654.488420:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d48840 going to sleep for 11 seconds 00000100:00100000:3.0:1790945654.493524:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273664384 00000100:00100000:3.0:1790945654.493540:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273664384 00000100:00100000:3.0:1790945654.493692:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790945654.493703:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+14:14986:x1877942273664384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790945654.494064:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+14:14986:x1877942273664384:12345-0@lo:502:mount.lustre.0 Request processed in 362us (5754us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945654.494079:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790945654.494316:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790945654.494604:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1790945654.494730:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1790945654.494769:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1790945654.494966:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1790945654.495016:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1790945654.495049:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1790945654.495096:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1790945654.495130:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1790945654.495162:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1790945654.495210:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1790945654.495247:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1790945654.495309:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1790945654.495351:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790945654.495409:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945654.503038:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8430036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945654.511060:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273664512 00000100:00100000:2.0:1790945654.511078:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273664512 00000100:00100000:2.0:1790945654.511293:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790945654.511305:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+14:14986:x1877942273664512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790945654.511601:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+14:14986:x1877942273664512:12345-0@lo:502:mount.lustre.0 Request processed in 298us (16189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945654.511610:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790945654.514965:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790945654.515127:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1790945654.515143:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1790945654.516871:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790945654.516882:0:15000:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1790945654.516903:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790945654.516905:0:15000:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790945654.516912:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790945654.516950:0:15000:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bb846fb99c0) 00000020:00000080:3.0:1790945654.516971:0:15000:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790945654.516978:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790945654.517047:0:15000:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb8654d2800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790945654.517055:0:15000:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790945654.517062:0:15000:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc5cf2c2a6a550328 00010000:00010000:2.0:1790945654.521335:0:15000:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1790945654.521838:0:15000:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1790945654.526884:0:15000:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1790945654.531797:0:15000:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790945654.531812:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945654.531817:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945654.531820:0:15000:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790945654.531822:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790945654.531826:0:15000:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1790945654.531827:0:15000:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790945654.531829:0:15000:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790945654.531830:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790945654.531833:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945654.531834:0:15000:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790945654.531836:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945654.531839:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945654.531840:0:15000:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790945654.531843:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790945654.531845:0:15000:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790945654.531847:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945654.531849:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945654.531850:0:15000:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790945654.531853:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790945654.531855:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945654.531856:0:15000:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790945654.531860:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790945654.531967:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790945654.531980:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945654.531981:0:15000:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790945654.531985:0:15000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1790945654.532147:0:14986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1790945654.532183:0:14986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790945654.532206:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b133a00/0xc5cf2c2a6a550313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55031a expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.532219:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb87b133a00/0xc5cf2c2a6a550313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55031a expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945654.532227:0:14986:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb8654d2800 from 1 10000000:01000000:1.0:1790945654.532230:0:14986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790945654.532265:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.532272:0:14986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.532282:0:14986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945654.532315:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790945654.532381:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945654.532426:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945654.532787:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273664640 00000100:00100000:2.0:1790945654.532795:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273664640 00000100:00100000:2.0:1790945654.532903:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790945654.532913:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+14:14986:x1877942273664640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790945654.532937:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945654.532951:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865431800/0xc5cf2c2a6a550336 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a55032f expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.532984:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865431800/0xc5cf2c2a6a550336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a55032f expref: 15 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.532996:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865431800/0xc5cf2c2a6a550336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a55032f expref: 15 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.533005:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431800, rc 0) 00000100:00100000:2.0:1790945654.533053:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+15:14986:x1877942273664640:12345-0@lo:101:mount.lustre.0 Request processed in 141us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945654.533061:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790945654.533141:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790945654.533165:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550336 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.533174:0:14986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a550336 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790945654.533682:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790945654.533982:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790945654.534223:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1790945654.534267:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1790945654.534331:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1790945654.534340:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1790945654.534395:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790945654.534441:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945654.536555:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d483c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945654.540839:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273664768 00000100:00100000:3.0:1790945654.540858:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273664768 00000100:00100000:3.0:1790945654.540940:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790945654.540951:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+15:14986:x1877942273664768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790945654.541629:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+15:14986:x1877942273664768:12345-0@lo:501:mount.lustre.0 Request processed in 678us (7185us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945654.541639:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790945654.546060:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790945654.546130:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790945654.546209:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945654.546254:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85181fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945654.546323:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273664896 00000100:00100000:3.0:1790945654.546330:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273664896 00000100:00100000:3.0:1790945654.546386:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790945654.546395:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+15:14986:x1877942273664896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790945654.546594:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+15:14986:x1877942273664896:12345-0@lo:503:mount.lustre.0 Request processed in 199us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945654.546603:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790945654.546721:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273664896:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790945654.547340:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790945654.547431:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790945654.547483:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945654.547513:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb842bb16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945654.550402:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273665024 00000100:00100000:1.0:1790945654.550419:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273665024 00000100:00100000:1.0:1790945654.550487:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790945654.550498:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+15:14986:x1877942273665024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790945654.550825:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+15:14986:x1877942273665024:12345-0@lo:502:mount.lustre.0 Request processed in 329us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945654.550833:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790945654.551027:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790945654.551363:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1790945654.551424:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1790945654.551481:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1790945654.551522:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1790945654.551558:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1790945654.551609:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1790945654.551648:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1790945654.551739:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1790945654.551790:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790945654.551846:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945654.551888:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87391fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945654.552248:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273665152 00000100:00100000:1.0:1790945654.552256:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273665152 00000100:00100000:1.0:1790945654.552303:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790945654.552312:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+15:14986:x1877942273665152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790945654.552489:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+15:14986:x1877942273665152:12345-0@lo:502:mount.lustre.0 Request processed in 177us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945654.552497:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790945654.553877:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790945654.554053:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1790945654.554068:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000040:00080000:3.0:1790945654.557573:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:0.0:1790945654.564476:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945654.564493:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945654.564496:0:15004:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790945654.564505:0:15004:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb8654d2800 00000020:00000080:0.0:1790945654.564508:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790945654.564515:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945654.564517:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945654.564518:0:15004:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790945654.564520:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945654.564523:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945654.564524:0:15004:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790945654.564527:0:15004:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb8654d2800 00000020:00000080:0.0:1790945654.564529:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790945654.564587:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945654.564590:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945654.564592:0:15004:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790945654.564594:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945654.564596:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945654.564598:0:15004:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790945654.564601:0:15004:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bb8654d2800 00000020:00000080:0.0:1790945654.564603:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790945654.564637:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945654.564640:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945654.564642:0:15004:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790945654.564645:0:15004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1790945654.564907:0:14986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790945654.564949:0:14986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945654.564975:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550336 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.564986:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550336 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945654.565029:0:14986:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790945654.565032:0:14986:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bb8654d2800 10000000:01000000:2.0:1790945654.565035:0:14986:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bb8654d2800 10000000:01000000:2.0:1790945654.565039:0:14986:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790945654.565044:0:14986:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bb8654d2800 from 1 10000000:01000000:2.0:1790945654.565046:0:14986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945654.565080:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865430c00/0xc5cf2c2a6a55033d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.565088:0:14986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb865430c00/0xc5cf2c2a6a55033d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.565100:0:14986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb865430c00/0xc5cf2c2a6a55033d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945654.565137:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665280:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790945654.565225:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945654.565266:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85209d240 going to sleep for 11 seconds 00000100:00100000:1.0:1790945654.565378:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273665280 00000100:00100000:1.0:1790945654.565388:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273665280 00000100:00100000:1.0:1790945654.565440:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790945654.565449:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+15:14986:x1877942273665280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790945654.565465:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945654.565477:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb87b133200/0xc5cf2c2a6a550344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a55033d expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.565501:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb87b133200/0xc5cf2c2a6a550344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a55033d expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.565512:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb87b133200/0xc5cf2c2a6a550344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a55033d expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945654.565522:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb87b133200, rc 0) 00000100:00100000:1.0:1790945654.565559:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+16:14986:x1877942273665280:12345-0@lo:101:mount.lustre.0 Request processed in 111us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945654.565566:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790945654.566921:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665280:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790945654.566956:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb865430c00/0xc5cf2c2a6a55033d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550344 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.566967:0:14986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb865430c00/0xc5cf2c2a6a55033d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a550344 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790945654.573493:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1790945654.573920:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945654.582323:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790945654.582426:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790945654.582475:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790945654.582520:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790945654.582555:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790945654.582600:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790945654.582633:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790945654.582690:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790945654.582770:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790945654.582807:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790945654.582839:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790945654.582886:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790945654.582921:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790945654.582970:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790945654.583017:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790945654.583054:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790945654.583091:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790945654.583141:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790945654.583192:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790945654.583230:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790945654.583292:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790945654.583329:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790945654.583365:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790945654.583415:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790945654.583452:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1790945654.583488:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1790945654.583538:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1790945654.583575:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1790945654.583701:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1790945654.583709:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1790945654.583813:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790945654.583883:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945654.589208:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273665408 00000100:00100000:1.0:1790945654.589223:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273665408 00000100:00100000:1.0:1790945654.589282:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790945654.589293:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+16:14986:x1877942273665408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790945654.589604:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+16:14986:x1877942273665408:12345-0@lo:501:mount.lustre.0 Request processed in 312us (5719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945654.589613:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790945654.592121:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85209d240 going to sleep for 11 seconds 00000100:00100000:2.0:1790945654.592171:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790945654.592242:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665536:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790945654.592324:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945654.592383:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273665536 00000100:00100000:2.0:1790945654.592391:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273665536 00000100:00100000:2.0:1790945654.592456:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790945654.592466:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+16:14986:x1877942273665536:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790945654.592692:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+16:14986:x1877942273665536:12345-0@lo:503:mount.lustre.0 Request processed in 226us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945654.592700:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790945654.596958:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85209d240 going to sleep for 11 seconds 00000100:00100000:2.0:1790945654.597006:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665536:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790945654.607048:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790945654.607153:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665664:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790945654.607241:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945654.607277:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb855b95900 going to sleep for 11 seconds 00000100:00100000:1.0:1790945654.607912:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273665664 00000100:00100000:1.0:1790945654.607920:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273665664 00000100:00100000:1.0:1790945654.607990:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790945654.608000:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+16:14986:x1877942273665664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790945654.608252:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+16:14986:x1877942273665664:12345-0@lo:502:mount.lustre.0 Request processed in 252us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945654.608259:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790945654.609166:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665664:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790945654.609463:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790945654.609519:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790945654.609567:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790945654.609615:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790945654.609652:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790945654.614025:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790945654.614064:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790945654.614091:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790945654.614135:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790945654.614172:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790945654.614206:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790945654.614257:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790945654.614294:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790945654.614329:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790945654.614396:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790945654.614436:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790945654.614472:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790945654.614522:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790945654.614575:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790945654.614612:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790945654.614687:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790945654.615269:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790945654.615314:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790945654.615366:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790945654.615404:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790945654.615434:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790945654.615495:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790945654.615532:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790945654.615577:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790945654.615626:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790945654.615684:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790945654.619513:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790945654.619645:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790945654.619757:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790945654.619808:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790945654.619865:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790945654.619904:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790945654.619954:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790945654.620008:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790945654.620048:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790945654.620104:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665792:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790945654.620185:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945654.620231:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb85209d240 going to sleep for 11 seconds 00000100:00100000:3.0:1790945654.620259:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273665792 00000100:00100000:3.0:1790945654.620274:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273665792 00000100:00100000:3.0:1790945654.620329:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790945654.620338:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+16:14986:x1877942273665792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790945654.620564:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+16:14986:x1877942273665792:12345-0@lo:502:mount.lustre.0 Request processed in 227us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945654.620572:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790945654.622405:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273665792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790945654.622565:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1790945654.622582:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1790945654.623626:0:15009:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790945654.623641:0:15009:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bb87b5d4d40) 00000020:00000080:2.0:1790945654.623681:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1790945654.623760:0:15009:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb8654d2800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790945654.623764:0:15009:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb8654d2800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790945654.623766:0:15009:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bb8654d2800 3 00010000:00080000:2.0:1790945654.623793:0:15009:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb850ade000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.148@tcp at head 00010000:00010000:2.0:1790945654.627086:0:15009:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1790945654.627355:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790945654.627397:0:15009:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790945654.627410:0:15009:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc5cf2c2a6a550352 00000100:00080000:2.0:1790945654.627422:0:15009:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790945654.627445:0:15009:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bb850ade000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1790945654.627481:0:15009:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb86c932d80 x1877942273665920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790945654.627534:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1877942273665920:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790945654.627598:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945654.627678:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273665920 00000100:00100000:2.0:1790945654.627685:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273665920 00000100:00100000:2.0:1790945654.627712:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945654.627719:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3291:x1877942273665920:12345-0@lo:38:llog_process_th.0 00000100:00080000:3.0:1790945654.628962:0:15009:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790945654.628987:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790945654.628992:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790945654.628995:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790945654.628998:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790945654.629046:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945654.629058:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273666048:0@lo:400:kworker.0 00000100:00100000:3.0:1790945654.629111:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790945654.630526:0:14304:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 400 last 0 00000100:00100000:3.0:1790945654.630734:0:14305:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790945654.630744:0:14305:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:00000080:2.0:1790945654.630846:0:14304:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc5cf2c2a6a550359 00000004:00100000:2.0:1790945654.630865:0:14304:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790945654.633207:0:14304:0:(import.c:65:import_set_state_nolock()) ffff9bb877a82000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945654.634037:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1877942273665920:12345-0@lo:38:llog_process_th.0 Request processed in 6312us (6434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945654.634050:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945654.634083:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273666048 00000100:00100000:2.0:1790945654.634092:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273666048 00000100:00100000:2.0:1790945654.634123:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945654.634129:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273666048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945654.634179:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273666048:12345-0@lo:400:kworker.0 Request processed in 50us (5068us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945654.634185:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790945654.634230:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bb87fe02680 x1877942273666048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945654.634247:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273666048:0@lo:400:kworker.0 00010000:00080000:0.0:1790945654.634324:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bb86c932d80 x1877942273665920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790945664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945654.634333:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790945654.634340:0:3291:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1790945654.634352:0:3291:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790945654.634357:0:3291:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790945654.634360:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb850ade000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790945654.634366:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3291:1877942273665920:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1790945654.634914:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1790945654.635018:0:14986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1790945654.635048:0:14986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790945654.635071:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865430c00/0xc5cf2c2a6a55033d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550344 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945654.635081:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865430c00/0xc5cf2c2a6a55033d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550344 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790945654.635130:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790945654.635133:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790945654.635137:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945654.635138:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790945654.635140:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945654.635141:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945654.635143:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790945654.635145:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945654.635146:0:14986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790945654.635151:0:14986:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1790945654.635153:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790945654.635154:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790945654.635155:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945654.635156:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790945654.635157:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945654.635157:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945654.635158:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790945654.635159:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945654.635160:0:14986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790945654.635187:0:14986:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790945654.635207:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273666176:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790945654.635266:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945654.635300:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb845ec9480 going to sleep for 11 seconds 00000100:00100000:1.0:1790945654.636859:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273666176 00000100:00100000:1.0:1790945654.636872:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273666176 00000100:00100000:1.0:1790945654.636945:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790945654.636958:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+16:14986:x1877942273666176:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790945654.636998:0:14297:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790945654.637015:0:14297:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790945654.708693:0:14297:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790945654.708708:0:14297:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790945654.708767:0:14320:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790945654.708773:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790945654.708796:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.708814:0:14320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb865d1d800/0xc5cf2c2a6a5502cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5502c6 expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.708824:0:14320:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.708864:0:14320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb865d1d800/0xc5cf2c2a6a5502cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a5502c6 expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.708878:0:14320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb865d1d800/0xc5cf2c2a6a5502cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a5502c6 expref: 16 pid: 14298 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945654.708893:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1877942273666304:0@lo:104: 00000100:00100000:2.0:1790945654.708971:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945654.709018:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8582e7540 going to sleep for 11 seconds 00000100:00100000:0.0:1790945654.709267:0:14288:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273666304 00000100:00100000:0.0:1790945654.709275:0:14288:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273666304 00000100:00100000:0.0:1790945654.709320:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790945654.709329:0:14288:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ac65209-3704-434c-a055-442590f14168+3:14320:x1877942273666304:12345-0@lo:104: 00010000:00010000:0.0:1790945654.709341:0:14288:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a5502cd expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945654.709394:0:14288:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790945654.709400:0:14288:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ac65209-3704-434c-a055-442590f14168+3:14320:x1877942273666304:12345-0@lo:104: Request processed in 72us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945654.709408:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790945654.709551:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945654.709557:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a5502cd expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.709565:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5800 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945654.709569:0:14293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a5502cd expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.709578:0:14293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a5502cd expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945654.709605:0:14293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a5502cd expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945654.709611:0:14293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790945654.709712:0:14293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a5502cd expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.709719:0:14293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945654.709739:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a5502cd expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.709747:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5800/0xc5cf2c2a6a5502c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a5502cd expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.709763:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945654.709766:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945654.709767:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945654.709782:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273666432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945654.709812:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945654.709854:0:14291:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273666432 00000100:00100000:2.0:1790945654.709857:0:14291:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273666432 00010000:00010000:2.0:1790945654.709873:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb865d1d800/0xc5cf2c2a6a5502cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a5502c6 expref: 17 pid: 14298 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945654.709891:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945654.709897:0:14291:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ac65209-3704-434c-a055-442590f14168+17:3292:x1877942273666432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945654.709907:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945654.709912:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb865d1d800/0xc5cf2c2a6a5502cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a5502c6 expref: 17 pid: 14298 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.709939:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb865d1d800/0xc5cf2c2a6a5502cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a5502c6 expref: 17 pid: 14298 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.709952:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.709959:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790945654.709972:0:14291:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002209777s 00010000:00010000:2.0:1790945654.709976:0:14291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.709983:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.709991:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.709997:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.710002:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865431000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945654.710006:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.710014:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.710023:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.710037:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945654.710063:0:14291:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ac65209-3704-434c-a055-442590f14168+17:3292:x1877942273666432:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945654.710069:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945654.710106:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273666432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945654.710127:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865d1d800/0xc5cf2c2a6a5502cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a5502c6 expref: 16 pid: 14298 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945654.710135:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1877942273666304:0@lo:104: 00010000:00010000:2.0:1790945654.710145:0:14320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.710463:0:14320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.710473:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945654.710480:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865431000/0xc5cf2c2a6a550360 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945654.726806:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+15:14986:x1877942273666176:12345-0@lo:253:mount.lustre.0 Request processed in 89841us (91529us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945654.726821:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790945654.728307:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:14986:1877942273666176:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790945654.728327:0:14986:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790945654.728330:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790945654.728332:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790945654.728333:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790945654.728335:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790945654.728336:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790945654.728338:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790945654.728339:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790945654.728341:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790945654.728342:0:14986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790945654.728358:0:14986:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790945654.742337:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1790945654.742499:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790945654.742677:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1790945654.742851:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790945654.743015:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1790945654.743227:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790945654.755490:0:14986:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790945654.964147:0:14986:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790945654.964156:0:14986:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790945654.964203:0:14986:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790945654.964267:0:14986:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790945654.964285:0:14986:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790945654.964316:0:14986:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1790945655.262507:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945656.284820:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790945656.611316:0:14301:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790945656.611324:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bb87390c000 from 7 10000000:01000000:1.0:1790945656.611330:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790945656.611377:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945656.611388:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945656.611399:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945656.611424:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273666560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790945656.611489:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945656.611547:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b566c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945656.612127:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273666560 00000100:00100000:2.0:1790945656.612143:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273666560 00000100:00100000:2.0:1790945656.612197:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790945656.612206:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+15:14301:x1877942273666560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945656.612220:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945656.612235:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865431400/0xc5cf2c2a6a55036e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a550367 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945656.612272:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865431400/0xc5cf2c2a6a55036e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550367 expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945656.612282:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865431400/0xc5cf2c2a6a55036e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550367 expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945656.612291:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431400, rc 0) 00000100:00100000:2.0:1790945656.612336:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+16:14301:x1877942273666560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945656.612343:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790945656.612644:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273666560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945656.612738:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55036e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945656.612749:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a55036e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945656.612804:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273666688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790945656.612835:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945656.612858:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b566c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945656.615064:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273666688 00000100:00100000:2.0:1790945656.615077:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273666688 00000100:00100000:2.0:1790945656.615155:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790945656.615166:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+16:14301:x1877942273666688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790945656.615189:0:14297:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790945656.615206:0:14297:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790945656.615209:0:14297:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1790945656.615348:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+16:14301:x1877942273666688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 183us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945656.615356:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790945656.615404:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273666688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790945656.615469:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790945656.615802:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55036e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945656.615814:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55036e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945657.307856:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945658.332432:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945659.358587:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790945659.681605:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790945659.681612:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790945659.681616:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790945659.681618:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790945659.681683:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273667072:0@lo:400:kworker.0 00000100:00100000:3.0:1790945659.681767:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945659.681818:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945659.681825:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273666944:0@lo:400:kworker.0 00000100:00100000:3.0:1790945659.681848:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945659.682026:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ac65209-3704-434c-a055-442590f14168:3293:1877942273666816:0@lo:400:kworker.0 00000100:00100000:2.0:1790945659.682062:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945659.682107:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273667072 00000100:00100000:2.0:1790945659.682114:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273667072 00000100:00100000:2.0:1790945659.682167:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273666944 00000100:00100000:2.0:1790945659.682171:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273666944 00000100:00080000:1.0:1790945659.682260:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945659.686164:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273666816 00000100:00100000:3.0:1790945659.686179:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273666816 00000100:00100000:3.0:1790945659.686240:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790945659.686250:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+16:3293:x1877942273666816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945659.686555:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+16:3293:x1877942273666816:12345-0@lo:400:kworker.0 Request processed in 305us (4491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945659.686563:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790945659.695457:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790945659.695490:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273667072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945659.695597:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273667072:12345-0@lo:400:kworker.0 Request processed in 122us (13829us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945659.695605:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790945659.695638:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790945659.695645:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273666944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945659.695693:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273666944:12345-0@lo:400:kworker.0 Request processed in 49us (13844us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945659.695699:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790945659.695763:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb87fe00e00 x1877942273666944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945659.695778:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273666944:0@lo:400:kworker.0 00010000:00080000:3.0:1790945659.695793:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb87fe02a00 x1877942273667072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945659.695802:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273667072:0@lo:400:kworker.0 00000100:00100000:3.0:1790945659.695936:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ac65209-3704-434c-a055-442590f14168:3293:1877942273666816:0@lo:400:kworker.0 00010000:00010000:3.0:1790945660.379817:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790945661.349185:0:15354:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790945661.404946:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945662.427927:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945663.455574:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945664.477760:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790945664.796064:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790945664.796071:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790945664.796073:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790945664.796076:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790945664.796253:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273667200:0@lo:400:kworker.0 00000100:00100000:2.0:1790945664.796334:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945664.796399:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790945664.796405:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273667328:0@lo:400:kworker.0 00000100:00100000:2.0:1790945664.796452:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945664.796477:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273667456:0@lo:400:kworker.0 00000100:00100000:2.0:1790945664.796498:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1790945664.797435:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790945664.797518:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273667328 00000100:00100000:3.0:1790945664.797525:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273667328 00000100:00100000:3.0:1790945664.797574:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273667456 00000100:00100000:3.0:1790945664.797578:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273667456 00000100:00100000:3.0:1790945664.797617:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790945664.797626:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273667328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945664.797733:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273667328:12345-0@lo:400:kworker.0 Request processed in 107us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945664.797740:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790945664.797758:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790945664.797764:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273667456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945664.797796:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273667456:12345-0@lo:400:kworker.0 Request processed in 32us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945664.797801:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790945664.797846:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86c931c00 x1877942273667456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945664.797860:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273667456:0@lo:400:kworker.0 00010000:00080000:3.0:1790945664.797892:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86c931180 x1877942273667328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945664.797900:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273667328:0@lo:400:kworker.0 00000100:00080000:1.0:1790945664.798053:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945664.798310:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273667200 00000100:00100000:0.0:1790945664.798316:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273667200 00000100:00100000:0.0:1790945664.798349:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790945664.798357:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+16:3292:x1877942273667200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945664.798401:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+16:3292:x1877942273667200:12345-0@lo:400:kworker.0 Request processed in 45us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945664.798407:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790945664.798445:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273667200:0@lo:400:kworker.0 00010000:00010000:3.0:1790945665.500020:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945666.524794:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.552487:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945667.932097:0:3291:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790945652/real 1790945652] req@ffff9bb87b376680 x1877942273663360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790945667 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945667.932127:0:3291:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bb87b376680 x1877942273663360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790945667 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945667.932137:0:3291:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790945652/real 1790945652] req@ffff9bb87b374e00 x1877942273663488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790945667 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945667.932149:0:3291:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bb87b374e00 x1877942273663488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790945667 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790945667.932170:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb8818f6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790945667.932203:0:3291:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790945667.932207:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273663360:0@lo:8:kworker.0 00000100:00080000:0.0:1790945667.932213:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb865e73800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790945667.932228:0:3291:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790945667.932231:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273663488:0@lo:8:kworker.0 00000100:00080000:2.0:1790945667.932363:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790945667.932368:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790945667.932377:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bb8818f6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790945667.932381:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 398 00000100:00080000:2.0:1790945667.932386:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790945667.932396:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bb8818f6800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1790945667.932417:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb86c932680 x1877942273667712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790945667.932430:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790945667.932434:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790945667.932435:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bb865e73800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790945667.932438:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 398 00000100:00080000:2.0:1790945667.932441:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790945667.932445:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bb865e73800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1790945667.932456:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb86c931f80 x1877942273667840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790945667.932731:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945667.932748:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ac65209-3704-434c-a055-442590f14168:3294:1877942273667584:0@lo:400:kworker.0 00000100:00100000:2.0:1790945667.932834:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945667.932900:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273667584 00000100:00100000:2.0:1790945667.932909:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273667584 00000100:00100000:2.0:1790945667.932951:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790945667.932961:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+16:3294:x1877942273667584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945667.933038:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+16:3294:x1877942273667584:12345-0@lo:400:kworker.0 Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945667.933045:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790945667.933091:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ac65209-3704-434c-a055-442590f14168:3294:1877942273667584:0@lo:400:kworker.0 00000100:00100000:0.0:1790945667.933249:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273667712:0@lo:8:kworker.0 00000100:00100000:0.0:1790945667.933281:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945667.933307:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273667840:0@lo:8:kworker.0 00000100:00100000:0.0:1790945667.933329:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945667.933371:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273667968:0@lo:400:kworker.0 00000100:00100000:0.0:1790945667.933398:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945667.933417:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945667.933423:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273668096:0@lo:400:kworker.0 00000100:00100000:0.0:1790945667.933444:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945667.933476:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273667968 00000100:00100000:0.0:1790945667.933480:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273667968 00000100:00100000:0.0:1790945667.933506:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273668096 00000100:00100000:0.0:1790945667.933510:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273668096 00000100:00100000:0.0:1790945667.933536:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790945667.933542:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273667968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945667.933579:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1877942273667968:12345-0@lo:400:kworker.0 Request processed in 37us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945667.933585:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790945667.933598:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790945667.933603:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273668096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945667.933625:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273668096:12345-0@lo:400:kworker.0 Request processed in 23us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945667.933630:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1790945667.933650:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790945667.933704:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86c931c00 x1877942273668096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945667.933715:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273668096:0@lo:400:kworker.0 00010000:00080000:0.0:1790945667.933724:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86c931180 x1877942273667968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945667.933732:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1877942273667968:0@lo:400:kworker.0 00000100:00100000:2.0:1790945667.933895:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273667712 00000100:00100000:2.0:1790945667.933901:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273667712 00000100:00100000:2.0:1790945667.933916:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273667840 00000100:00100000:2.0:1790945667.933918:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273667840 00000100:00100000:2.0:1790945667.933927:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945667.933931:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3291:x1877942273667712:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790945667.933955:0:14987:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:2.0:1790945667.933997:0:14987:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5cf2c2a6a550375 00002000:00100000:2.0:1790945667.934014:0:14987:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bb850a92000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790945667.934019:0:14987:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790945667.934023:0:14987:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790945667.934636:0:14987:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790945667.934702:0:14987:0:(import.c:65:import_set_state_nolock()) ffff9bb850a97000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945667.934774:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1877942273667712:12345-0@lo:8:kworker.0 Request processed in 840us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945667.934781:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945667.934818:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945667.934823:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3291:x1877942273667840:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790945667.934838:0:14987:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790945667.934863:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3291:x1877942273667840:12345-0@lo:8:kworker.0 Request processed in 39us (1533us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790945667.934869:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790945667.934986:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86c932680 x1877942273667712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790945687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945667.934999:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790945667.935008:0:3291:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790945667.935020:0:3291:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790945667.935025:0:3291:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790945667.935036:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb8818f6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790945667.935059:0:3291:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790945667.935065:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273667712:0@lo:8:kworker.0 00000100:00080000:0.0:1790945667.935080:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb865e73800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790945667.935084:0:3291:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790945667.935087:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273667840:0@lo:8:kworker.0 00000004:00080000:2.0:1790945667.935362:0:14327:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1790945667.935385:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14327:1877942273668352:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790945667.935429:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945667.935465:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb845e00540 going to sleep for 11 seconds 00000004:00080000:2.0:1790945667.935480:0:14326:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790945667.935784:0:14326:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413731126400ns, next at 0ns, rc = 0 00000100:00100000:0.0:1790945667.936427:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790945667.936441:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273668224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945667.936486:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945667.936643:0:14989:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273668352 00000100:00100000:1.0:1790945667.936652:0:14989:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273668352 00000100:00100000:1.0:1790945667.936720:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790945667.936732:0:14989:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14327:x1877942273668352:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1790945667.937140:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945667.939181:0:14991:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273668224 00000100:00100000:2.0:1790945667.940145:0:14991:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273668224 00000100:00100000:2.0:1790945667.940276:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945667.940287:0:14991:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1877942273668224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945667.940324:0:14991:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945667.940412:0:14991:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1877942273668224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (3925us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945667.940419:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790945667.940478:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb86c930000 x1877942273668224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945667.940500:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273668224:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1790945667.945548:0:14989:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1790945667.945563:0:14989:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1790945667.945568:0:14989:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1790945667.954692:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.954704:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a55037c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.954723:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.954728:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.954734:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a55037c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.954752:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a55037c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.954762:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a55037c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.954770:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a55037c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.954787:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790945667.954812:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945667.954824:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a55037c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.954831:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132200 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945667.954836:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a55037c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.954845:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a55037c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.954862:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a55037c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.954869:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a55037c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.954888:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945667.954890:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945667.954891:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.955541:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.955548:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a550383 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.955558:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.955561:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.955565:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a550383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.955583:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a550383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.955593:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a550383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.955600:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a550383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.955695:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945667.956178:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945667.956256:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a550383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.956266:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132800 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945667.956271:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a550383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.956279:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a550383 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.956295:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a550383 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.956313:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a550383 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.956333:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945667.956335:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945667.956336:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.956525:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.956531:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a55038a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.956540:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.956543:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.956547:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a55038a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.956556:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a55038a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.956563:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a55038a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.956579:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a55038a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.956602:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945667.956840:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945667.956846:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a55038a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.956853:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945667.956856:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a55038a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.956864:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a55038a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.956874:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a55038a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.956881:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a55038a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.956896:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945667.956898:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945667.956899:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.957487:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.957493:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a550391 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.957503:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.957506:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.957510:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a550391 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.957519:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a550391 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.957527:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a550391 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.957533:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a550391 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.957549:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790945667.957560:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945667.957565:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a550391 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.957578:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132e00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945667.957581:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a550391 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.957587:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a550391 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.957598:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a550391 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.957605:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a550391 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.957619:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945667.957620:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945667.957622:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.962752:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.962763:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a550398 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.962781:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.962786:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.962793:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a550398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.962819:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a550398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.962836:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a550398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.962845:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a550398 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.962872:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945667.962891:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945667.962898:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a550398 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.962914:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132200 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945667.962919:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a550398 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.962928:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a550398 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.962947:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a550398 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.962954:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a550398 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.962975:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.963088:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.963090:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.964051:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.964061:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a55039f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.964073:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.964077:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.964082:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a55039f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.964093:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a55039f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.964102:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a55039f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.964213:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a55039f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.964248:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790945667.964507:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945667.964514:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a55039f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.964532:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132600 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945667.964537:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a55039f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.964546:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a55039f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.964563:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a55039f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.964571:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a55039f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.964591:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945667.964593:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945667.964594:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.965606:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.965616:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.965629:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.965633:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.965638:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.965648:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.965673:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.965682:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.965700:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945667.965839:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945667.965846:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.965854:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132e00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945667.965858:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.965867:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.965886:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.965894:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.965909:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.965911:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.965913:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.966110:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.966116:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.966124:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.966132:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.966136:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.966738:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.966749:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.966757:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.966813:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790945667.967316:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.967323:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.967333:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.967337:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.967341:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.967351:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.967359:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.967371:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.967713:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790945667.967721:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.967730:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945667.967735:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.967744:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.967766:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.967773:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.968018:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945667.968023:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.968030:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132a00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945667.968034:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.968042:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.968053:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.968060:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945667.968062:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945667.968064:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945667.968249:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790945667.968255:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.968277:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.969764:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.969774:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.969788:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.969793:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.969809:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.969822:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.969831:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.969838:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.969867:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790945667.969982:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945667.969990:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.970008:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133600 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945667.970012:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.970021:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.970035:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.970043:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.970060:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945667.970061:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945667.970063:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.971487:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.971497:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a5503c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.971515:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.971519:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.971828:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a5503c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.971842:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a5503c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.971851:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a5503c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.971858:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a5503c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.971874:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790945667.971955:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945667.971961:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a5503c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.971970:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132c00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945667.971980:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a5503c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.971990:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a5503c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.972004:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a5503c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.972012:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084ca7022/0xc5cf2c2a6a5503c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.972030:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945667.972032:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945667.972034:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790945667.973411:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1790945667.974744:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.974756:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.974772:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.974776:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.974782:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.974940:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.974954:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.974968:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.975154:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790945667.975771:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.975778:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.975788:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.975792:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.975805:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.975817:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.975826:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.975833:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.975878:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790945667.975886:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.975894:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132a00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945667.975899:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.975909:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.975934:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503c9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.975942:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002eb0a0f7/0xc5cf2c2a6a5503c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.975965:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945667.975968:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.975975:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133600 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945667.975991:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.975998:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.976008:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.976016:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945667.976017:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945667.976019:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945667.976319:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790945667.976325:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001591217e/0xc5cf2c2a6a5503d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790945667.976829:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.976836:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.976847:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.976850:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.976855:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.976865:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.976874:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.976880:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.976966:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945667.976973:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.976991:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945667.976995:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.977003:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.977016:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.977025:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945667.977035:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945667.977037:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790945667.977261:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790945667.977267:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bb75617/0xc5cf2c2a6a5503d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790945667.977733:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.977740:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a5503de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.977763:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.977766:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.977771:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a5503de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.977782:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a5503de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.977791:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a5503de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.977809:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a5503de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.978014:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945667.978020:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a5503de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.978272:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790945667.978463:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.979867:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.979879:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a5503e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.980086:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.980091:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.980097:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a5503e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.980257:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132600 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945667.980263:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a5503de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.980273:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a5503de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.980280:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a5503e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.980287:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a5503de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.980296:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004013e43d/0xc5cf2c2a6a5503de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.980299:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a5503e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.980306:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a5503e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.980320:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945667.980323:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a5503e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.980328:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790945667.980329:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945667.980332:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a5503e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.980339:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a5503e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.980347:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a5503e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.980360:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a1c01f6/0xc5cf2c2a6a5503e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945667.980373:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945667.980375:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945667.980377:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.980876:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.981014:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.981020:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a5503ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.981031:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.981035:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.981039:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a5503ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.981048:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a5503ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.981056:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a5503ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.981064:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a5503ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.981097:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945667.981748:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945667.981755:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a5503ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.981764:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132200 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945667.981769:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a5503ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.981778:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a5503ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.981817:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a5503ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.981825:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094182b78/0xc5cf2c2a6a5503ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.981844:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945667.981846:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945667.981848:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.982496:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.982504:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a5503f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.982516:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.982520:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.982525:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a5503f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.982535:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a5503f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.982543:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a5503f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.982550:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a5503f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.982575:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945667.983368:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945667.983376:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a5503f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.983385:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132800 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945667.983390:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a5503f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.983398:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a5503f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.983413:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a5503f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.983420:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9f6f679/0xc5cf2c2a6a5503f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.983451:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945667.983453:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945667.983455:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.983962:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.983970:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.983982:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.983991:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.983997:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.984009:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.984017:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.984024:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.984047:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945667.984108:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945667.984115:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.984123:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b132e00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945667.984126:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.984134:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.984145:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.984152:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ed145a3/0xc5cf2c2a6a5503fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.984177:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.984179:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.984180:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.986823:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.986836:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a475695/0xc5cf2c2a6a550401 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.986853:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.986857:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.986864:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a475695/0xc5cf2c2a6a550401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.986937:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a475695/0xc5cf2c2a6a550401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.986951:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a475695/0xc5cf2c2a6a550401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.986964:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a475695/0xc5cf2c2a6a550401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.990975:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790945667.990999:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790945667.991119:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a475695/0xc5cf2c2a6a550401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.991131:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167b200 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945667.991137:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a475695/0xc5cf2c2a6a550401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.991148:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a475695/0xc5cf2c2a6a550401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.991168:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a475695/0xc5cf2c2a6a550401 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.991176:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a475695/0xc5cf2c2a6a550401 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945667.991261:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945667.991263:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945667.991265:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.992043:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.992051:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8f0f5c1/0xc5cf2c2a6a550408 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.992064:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.992069:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.992075:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8f0f5c1/0xc5cf2c2a6a550408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.992088:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8f0f5c1/0xc5cf2c2a6a550408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.992097:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8f0f5c1/0xc5cf2c2a6a550408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.992118:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8f0f5c1/0xc5cf2c2a6a550408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.992139:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945667.992273:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945667.992280:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8f0f5c1/0xc5cf2c2a6a550408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.992288:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167a000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945667.992292:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8f0f5c1/0xc5cf2c2a6a550408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.992300:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8f0f5c1/0xc5cf2c2a6a550408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.992313:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8f0f5c1/0xc5cf2c2a6a550408 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.992321:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8f0f5c1/0xc5cf2c2a6a550408 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.992337:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.992339:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.992340:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.992551:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.992558:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55040f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.992572:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.992575:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.992580:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55040f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.992589:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55040f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.992599:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55040f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.992607:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55040f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.992631:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945667.992694:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945667.992699:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55040f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.992717:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167aa00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945667.992720:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55040f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.992727:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55040f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.992739:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55040f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.992746:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55040f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.992760:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.992762:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.992764:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.993049:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.993056:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0a792a0/0xc5cf2c2a6a550416 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.993065:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.993068:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.993072:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a792a0/0xc5cf2c2a6a550416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.993081:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0a792a0/0xc5cf2c2a6a550416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.993099:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0a792a0/0xc5cf2c2a6a550416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.993107:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a792a0/0xc5cf2c2a6a550416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.993127:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945667.993278:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945667.993283:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0a792a0/0xc5cf2c2a6a550416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.993291:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167ba00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945667.993294:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0a792a0/0xc5cf2c2a6a550416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.993302:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0a792a0/0xc5cf2c2a6a550416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.993320:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0a792a0/0xc5cf2c2a6a550416 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.993327:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0a792a0/0xc5cf2c2a6a550416 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.993339:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.993341:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.993342:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.993486:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.993492:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000697e16f9/0xc5cf2c2a6a55041d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.993501:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.993504:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.993508:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000697e16f9/0xc5cf2c2a6a55041d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.993517:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000697e16f9/0xc5cf2c2a6a55041d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.993526:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000697e16f9/0xc5cf2c2a6a55041d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.993533:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000697e16f9/0xc5cf2c2a6a55041d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.993564:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945667.993735:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945667.993740:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000697e16f9/0xc5cf2c2a6a55041d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.993748:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167b600 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945667.993751:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000697e16f9/0xc5cf2c2a6a55041d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.993759:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000697e16f9/0xc5cf2c2a6a55041d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.993770:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000697e16f9/0xc5cf2c2a6a55041d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.993777:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000697e16f9/0xc5cf2c2a6a55041d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.993810:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.993811:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.993813:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.993974:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.993980:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003353d3b2/0xc5cf2c2a6a550424 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.993989:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.993992:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.993996:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003353d3b2/0xc5cf2c2a6a550424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.994004:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003353d3b2/0xc5cf2c2a6a550424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.994011:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003353d3b2/0xc5cf2c2a6a550424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.994018:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003353d3b2/0xc5cf2c2a6a550424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.994040:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945667.994111:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945667.994116:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003353d3b2/0xc5cf2c2a6a550424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.994124:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167bc00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945667.994127:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003353d3b2/0xc5cf2c2a6a550424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.994135:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003353d3b2/0xc5cf2c2a6a550424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.994147:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003353d3b2/0xc5cf2c2a6a550424 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.994154:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003353d3b2/0xc5cf2c2a6a550424 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.994167:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.994169:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.994170:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.994399:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.994405:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f63cbf86/0xc5cf2c2a6a55042b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.994412:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.994420:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.994425:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f63cbf86/0xc5cf2c2a6a55042b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.994434:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f63cbf86/0xc5cf2c2a6a55042b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.994443:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f63cbf86/0xc5cf2c2a6a55042b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.994450:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f63cbf86/0xc5cf2c2a6a55042b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.994470:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945667.994726:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945667.994731:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f63cbf86/0xc5cf2c2a6a55042b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.994749:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167ae00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945667.994752:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f63cbf86/0xc5cf2c2a6a55042b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.994759:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f63cbf86/0xc5cf2c2a6a55042b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.994773:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f63cbf86/0xc5cf2c2a6a55042b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.994780:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f63cbf86/0xc5cf2c2a6a55042b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.994793:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.994794:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945667.994809:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945667.998554:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945667.998569:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004665413d/0xc5cf2c2a6a550432 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.998587:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945667.998591:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945667.998598:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004665413d/0xc5cf2c2a6a550432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.998612:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004665413d/0xc5cf2c2a6a550432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.998621:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004665413d/0xc5cf2c2a6a550432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.998638:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004665413d/0xc5cf2c2a6a550432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945667.998674:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945667.999133:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945667.999142:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004665413d/0xc5cf2c2a6a550432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.999151:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167a400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945667.999155:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004665413d/0xc5cf2c2a6a550432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945667.999165:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004665413d/0xc5cf2c2a6a550432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.000156:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004665413d/0xc5cf2c2a6a550432 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.000172:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004665413d/0xc5cf2c2a6a550432 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.000268:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945668.000270:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945668.000273:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790945668.000972:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790945668.000981:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057dbd4b1/0xc5cf2c2a6a550439 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945668.000995:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1790945668.000999:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945668.001004:0:14989:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057dbd4b1/0xc5cf2c2a6a550439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945668.001015:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057dbd4b1/0xc5cf2c2a6a550439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945668.001024:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057dbd4b1/0xc5cf2c2a6a550439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945668.001031:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057dbd4b1/0xc5cf2c2a6a550439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945668.001046:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945668.001239:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945668.001247:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057dbd4b1/0xc5cf2c2a6a550439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.001267:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167a600 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945668.001271:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057dbd4b1/0xc5cf2c2a6a550439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.001280:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057dbd4b1/0xc5cf2c2a6a550439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.001295:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057dbd4b1/0xc5cf2c2a6a550439 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.001302:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057dbd4b1/0xc5cf2c2a6a550439 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.001317:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945668.001319:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945668.001321:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1790945668.001861:0:14989:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1790945668.001975:0:14989:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14327:x1877942273668352:12345-0@lo:5:osp-pre-0-0.0 Request processed in 65241us (66539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945668.001990:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945668.002342:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14327:1877942273668352:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790945668.002361:0:14327:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1790945668.002409:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14327:1877942273668480:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790945668.002448:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.002492:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9a780 going to sleep for 11 seconds 00000100:00100000:3.0:1790945668.003331:0:14990:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273668480 00000100:00100000:3.0:1790945668.003341:0:14990:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273668480 00000100:00100000:3.0:1790945668.003387:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790945668.003397:0:14990:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14327:x1877942273668480:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1790945668.003441:0:14990:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1790945668.011847:0:14990:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14327:x1877942273668480:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8442us (9389us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790945668.011860:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790945668.012867:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14327:1877942273668480:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790945668.012885:0:14327:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000020:01000004:0.0:1790945668.087590:0:15704:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790945668.087594:0:15704:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1790945668.087748:0:15704:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bb850a71800 00000020:01000004:0.0:1790945668.087765:0:15704:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790945668.087779:0:15704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790945668.087792:0:15704:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bb86560b380) 00000020:00000080:0.0:1790945668.087817:0:15704:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790945668.111221:0:15704:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790945668.111595:0:15704:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790945668.113607:0:15704:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790945668.114216:0:15704:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1790945668.116305:0:15704:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790945668.117101:0:15704:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 521: rc = 0 00100000:10000000:3.0:1790945668.117314:0:15704:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 521: rc = 0 00100000:10000000:3.0:1790945668.117482:0:15704:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 521: rc = 0 00100000:10000000:3.0:1790945668.118298:0:15704:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 657: rc = 0 00100000:10000000:3.0:1790945668.118600:0:15704:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 657: rc = 0 00100000:10000000:3.0:1790945668.118852:0:15704:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 657: rc = 0 00100000:10000000:3.0:1790945668.120274:0:15704:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 657: rc = 0 00100000:10000000:3.0:1790945668.130458:0:15704:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 657: rc = 0 00100000:10000000:3.0:1790945668.132030:0:15704:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 657: rc = 0 00000020:00000080:3.0:1790945668.133062:0:15704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790945668.133076:0:15704:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790945668.133087:0:15704:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc5cf2c2a6a550447 00000020:01000004:3.0:1790945668.133094:0:15704:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1790945668.133644:0:15704:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790945668.133650:0:15704:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790945668.133754:0:15704:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790945668.133781:0:15704:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1790945668.133785:0:15704:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790945668.148080:0:15704:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790945668.148263:0:15704:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.148@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1790945668.148268:0:15704:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790945668.148269:0:15704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790945668.148271:0:15704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790945668.148272:0:15704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790945668.148274:0:15704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790945668.148275:0:15704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790945668.148277:0:15704:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790945668.148279:0:15704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790945668.148280:0:15704:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790945668.148284:0:15704:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1790945668.148286:0:15704:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790945668.148288:0:15704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790945668.148289:0:15704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790945668.148290:0:15704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790945668.148291:0:15704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790945668.148292:0:15704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790945668.148293:0:15704:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790945668.148294:0:15704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790945668.148295:0:15704:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790945668.148322:0:15704:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790945668.148342:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273668608:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790945668.148584:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.148714:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9a000 going to sleep for 11 seconds 00000100:00100000:3.0:1790945668.148977:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273668608 00000100:00100000:3.0:1790945668.148984:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273668608 00000100:00100000:2.0:1790945668.149299:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790945668.149310:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+16:15704:x1877942273668608:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790945668.149354:0:14299:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790945668.149357:0:14299:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1790945668.149360:0:14299:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790945668.196744:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+16:15704:x1877942273668608:12345-0@lo:253:mount.lustre.0 Request processed in 47427us (48151us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945668.196760:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790945668.196860:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273668608:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790945668.196875:0:15704:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790945668.196950:0:15704:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790945668.196966:0:15704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790945668.196967:0:15704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790945668.196969:0:15704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790945668.196970:0:15704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790945668.196971:0:15704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790945668.196973:0:15704:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790945668.197044:0:15704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790945668.197045:0:15704:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790945668.197067:0:15704:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bb850a71800 from lustre-OST0001 10000000:01000000:2.0:1790945668.197097:0:15704:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790945668.197101:0:15704:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790945668.197255:0:15704:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bb87b5d0000 local copy 00010000:00010000:2.0:1790945668.197267:0:15704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c800/0xc5cf2c2a6a5501ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5501f4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945668.197591:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273668736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790945668.197636:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.197756:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945668.197855:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273668736 00000100:00100000:0.0:1790945668.197863:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273668736 00000100:00100000:0.0:1790945668.198097:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790945668.198267:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+16:15704:x1877942273668736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790945668.198537:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+16:15704:x1877942273668736:12345-0@lo:501:mount.lustre.0 Request processed in 432us (900us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790945668.198546:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790945668.198636:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273668736:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790945668.198653:0:15704:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790945668.198852:0:15704:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790945668.198861:0:15704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c800/0xc5cf2c2a6a5501ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5501f4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.198871:0:15704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865d1c800/0xc5cf2c2a6a5501ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5501f4 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945668.198906:0:15704:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bb850a71800 10000000:01000000:3.0:1790945668.198912:0:15704:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790945668.198917:0:15704:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790945668.198926:0:15704:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790945668.198931:0:15704:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790945668.198933:0:15704:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790945668.198961:0:15704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a55044e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.198969:0:15704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a55044e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.198989:0:15704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a55044e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945668.199008:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273668864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790945668.199043:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945668.199926:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b5666c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790945668.200160:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273668864 00000100:00100000:2.0:1790945668.200168:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273668864 00000100:00100000:2.0:1790945668.200209:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790945668.200218:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb85a03d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+16:15704:x1877942273668864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790945668.200230:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945668.200246:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865431e00/0xc5cf2c2a6a550455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a55044e expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.200270:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865431e00/0xc5cf2c2a6a550455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a55044e expref: 17 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.200280:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865431e00/0xc5cf2c2a6a550455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a55044e expref: 17 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.200304:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431e00, rc 0) 00000100:00100000:2.0:1790945668.200363:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb85a03d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+17:15704:x1877942273668864:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945668.200369:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790945668.200693:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273668864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790945668.200708:0:15704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a55044e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550455 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.200718:0:15704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a55044e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a550455 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790945668.201834:0:15704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790945668.203520:0:15704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790945668.203829:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790945668.203874:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790945668.204597:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790945668.206746:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790945668.206874:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790945668.207069:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790945668.207782:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790945668.207793:0:15704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790945668.208288:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273668992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790945668.208354:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945668.208492:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b566480 going to sleep for 11 seconds 00000100:00100000:2.0:1790945668.208538:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273668992 00000100:00100000:2.0:1790945668.208545:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273668992 00000100:00100000:2.0:1790945668.208715:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790945668.208725:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb85a03d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+17:15704:x1877942273668992:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790945668.209437:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb85a03d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+17:15704:x1877942273668992:12345-0@lo:501:mount.lustre.0 Request processed in 712us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945668.209447:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790945668.209530:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273668992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790945668.209572:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790945668.209613:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.210728:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9a600 going to sleep for 11 seconds 00000100:00100000:0.0:1790945668.211730:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273669120 00000100:00100000:0.0:1790945668.211742:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273669120 00000100:00100000:0.0:1790945668.211805:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790945668.211815:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87380e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+17:15704:x1877942273669120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790945668.213051:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87380e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+17:15704:x1877942273669120:12345-0@lo:503:mount.lustre.0 Request processed in 1233us (3432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945668.213064:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790945668.213724:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669120:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790945668.214603:0:15704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790945668.214695:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669248:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790945668.214754:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.214786:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9a600 going to sleep for 11 seconds 00000100:00100000:0.0:1790945668.215632:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273669248 00000100:00100000:0.0:1790945668.215643:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273669248 00000100:00100000:0.0:1790945668.215724:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790945668.215734:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87380c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+17:15704:x1877942273669248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790945668.216551:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87380c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+17:15704:x1877942273669248:12345-0@lo:502:mount.lustre.0 Request processed in 642us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945668.216562:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790945668.217677:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669248:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790945668.218329:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790945668.218468:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790945668.218507:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790945668.218555:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790945668.218593:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790945668.218624:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790945668.218732:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790945668.218768:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790945668.218830:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1790945668.218876:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790945668.219295:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.219455:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9a600 going to sleep for 11 seconds 00000100:00100000:0.0:1790945668.219509:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273669376 00000100:00100000:0.0:1790945668.219516:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273669376 00000100:00100000:0.0:1790945668.219614:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790945668.219624:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87380dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+17:15704:x1877942273669376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790945668.219844:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87380dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+17:15704:x1877942273669376:12345-0@lo:502:mount.lustre.0 Request processed in 221us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945668.219852:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790945668.219997:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790945668.220070:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1790945668.220080:0:15704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1790945668.221045:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790945668.221055:0:15706:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1790945668.221062:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790945668.221065:0:15706:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790945668.221072:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790945668.221087:0:15706:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bb87b5d3380) 00000020:00000080:2.0:1790945668.221109:0:15706:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790945668.221115:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790945668.221302:0:15706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb850a71800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790945668.221309:0:15706:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790945668.221316:0:15706:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc5cf2c2a6a550463 00010000:00010000:3.0:1790945668.228266:0:15706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1790945668.230066:0:15706:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1790945668.233084:0:15706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1790945668.235300:0:15706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790945668.235314:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945668.235321:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945668.235322:0:15706:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790945668.235326:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945668.235331:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945668.235332:0:15706:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790945668.235335:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790945668.235336:0:15706:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790945668.235338:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945668.235340:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945668.235341:0:15706:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790945668.235343:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790945668.235345:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945668.235346:0:15706:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790945668.235349:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790945668.235480:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790945668.235483:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790945668.235485:0:15706:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790945668.235488:0:15706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1790945668.235634:0:15704:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1790945668.235687:0:15704:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790945668.235704:0:15704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a55044e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550455 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.235717:0:15704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb8821c4200/0xc5cf2c2a6a55044e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550455 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945668.235724:0:15704:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb850a71800 from 1 10000000:01000000:2.0:1790945668.235726:0:15704:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790945668.235771:0:15704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.235779:0:15704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.235790:0:15704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945668.235825:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790945668.235965:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.236173:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790945668.237991:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273669504 00000100:00100000:0.0:1790945668.238003:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273669504 00000100:00100000:0.0:1790945668.238050:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790945668.238059:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87380f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+17:15704:x1877942273669504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790945668.238074:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945668.238090:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865d1ca00/0xc5cf2c2a6a550471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a55046a expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945668.238114:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1ca00/0xc5cf2c2a6a550471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a55046a expref: 18 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945668.238132:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865d1ca00/0xc5cf2c2a6a550471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a55046a expref: 18 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945668.238442:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1ca00, rc 0) 00000100:00100000:0.0:1790945668.238508:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87380f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+18:15704:x1877942273669504:12345-0@lo:101:mount.lustre.0 Request processed in 451us (2544us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945668.238515:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790945668.239280:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790945668.239302:0:15704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550471 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.239312:0:15704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a550471 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790945668.240258:0:15704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1790945668.242688:0:15704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945668.244619:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1790945668.244714:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1790945668.244792:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1790945668.244813:0:15704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1790945668.245785:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790945668.245868:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.246113:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945668.250251:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273669632 00000100:00100000:1.0:1790945668.250267:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273669632 00000100:00100000:1.0:1790945668.250322:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790945668.250330:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87380fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+18:15704:x1877942273669632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790945668.250644:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87380fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+18:15704:x1877942273669632:12345-0@lo:501:mount.lustre.0 Request processed in 314us (4775us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945668.250653:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790945668.252336:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790945668.252396:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b379180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790945668.252469:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945668.252512:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843851780 going to sleep for 11 seconds 00000100:00100000:3.0:1790945668.253618:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273669760 00000100:00100000:3.0:1790945668.253628:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273669760 00000100:00100000:3.0:1790945668.253703:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790945668.253714:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87380e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+18:15704:x1877942273669760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790945668.254093:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87380e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+18:15704:x1877942273669760:12345-0@lo:503:mount.lustre.0 Request processed in 380us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945668.254102:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790945668.256179:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b379180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669760:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790945668.257562:0:15704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790945668.257647:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669888:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790945668.257746:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.257807:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9a600 going to sleep for 11 seconds 00000100:00100000:1.0:1790945668.257833:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273669888 00000100:00100000:1.0:1790945668.257841:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273669888 00000100:00100000:1.0:1790945668.257890:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790945668.257900:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+18:15704:x1877942273669888:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790945668.258101:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+18:15704:x1877942273669888:12345-0@lo:502:mount.lustre.0 Request processed in 202us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945668.258109:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790945668.258272:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273669888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790945668.258551:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790945668.258598:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790945668.258646:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790945668.259327:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790945668.259367:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790945668.259420:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790945668.259456:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790945668.259492:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1790945668.259529:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273670016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790945668.259604:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945668.259711:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87b5666c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945668.262770:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273670016 00000100:00100000:1.0:1790945668.262787:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273670016 00000100:00100000:1.0:1790945668.262915:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790945668.262926:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+18:15704:x1877942273670016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790945668.263290:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+18:15704:x1877942273670016:12345-0@lo:502:mount.lustre.0 Request processed in 365us (3685us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945668.263299:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790945668.267856:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273670016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790945668.268132:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1790945668.268159:0:15704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1790945668.269624:0:15710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945668.269637:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945668.269640:0:15710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790945668.269647:0:15710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb850a71800 00000020:00000080:0.0:1790945668.269650:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790945668.269684:0:15710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945668.269688:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945668.269690:0:15710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790945668.269693:0:15710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945668.269696:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945668.269697:0:15710:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790945668.269701:0:15710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bb850a71800 00000020:00000080:0.0:1790945668.269703:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790945668.269755:0:15710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945668.269759:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945668.269760:0:15710:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790945668.269764:0:15710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790945668.269766:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945668.269767:0:15710:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790945668.269770:0:15710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bb850a71800 00000020:00000080:0.0:1790945668.269772:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790945668.269815:0:15710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790945668.269818:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790945668.269827:0:15710:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790945668.269830:0:15710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1790945668.269965:0:15704:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790945668.270003:0:15704:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790945668.270027:0:15704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550471 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.270039:0:15704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a550471 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945668.270079:0:15704:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790945668.270083:0:15704:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bb850a71800 10000000:01000000:2.0:1790945668.270085:0:15704:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bb850a71800 10000000:01000000:2.0:1790945668.270089:0:15704:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790945668.270095:0:15704:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bb850a71800 from 1 10000000:01000000:2.0:1790945668.270098:0:15704:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790945668.270136:0:15704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865430a00/0xc5cf2c2a6a550478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.270157:0:15704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb865430a00/0xc5cf2c2a6a550478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.270168:0:15704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb865430a00/0xc5cf2c2a6a550478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945668.270194:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273670144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790945668.270274:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.270322:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945668.270494:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273670144 00000100:00100000:0.0:1790945668.270503:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273670144 00000100:00100000:0.0:1790945668.270553:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790945668.270563:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+18:15704:x1877942273670144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790945668.270577:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945668.270590:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865d1c600/0xc5cf2c2a6a55047f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a550478 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945668.270613:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1c600/0xc5cf2c2a6a55047f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550478 expref: 19 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945668.270624:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865d1c600/0xc5cf2c2a6a55047f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550478 expref: 19 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945668.270633:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c600, rc 0) 00000100:00100000:0.0:1790945668.270714:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+19:15704:x1877942273670144:12345-0@lo:101:mount.lustre.0 Request processed in 151us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945668.270721:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790945668.270980:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273670144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790945668.270995:0:15704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb865430a00/0xc5cf2c2a6a550478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55047f expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.271004:0:15704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb865430a00/0xc5cf2c2a6a550478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a55047f expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790945668.271548:0:15704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1790945668.271856:0:15704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790945668.272475:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790945668.272533:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790945668.272566:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790945668.272613:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790945668.272648:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790945668.272725:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790945668.272760:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790945668.272791:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790945668.273001:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790945668.273038:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790945668.273072:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790945668.273120:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790945668.276100:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790945668.276242:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790945668.276318:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790945668.276354:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790945668.276389:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790945668.276764:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790945668.276817:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790945668.276969:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790945668.277088:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790945668.277124:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790945668.277217:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790945668.277263:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790945668.277292:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1790945668.277319:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1790945668.277357:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1790945668.277632:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1790945668.277696:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1790945668.277757:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1790945668.277792:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1790945668.277995:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1790945668.278031:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1790945668.278093:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1790945668.278127:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1790945668.278310:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1790945668.278348:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1790945668.278536:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1790945668.278544:0:15704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1790945668.278653:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273670272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790945668.278789:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.278966:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945668.279474:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273670272 00000100:00100000:0.0:1790945668.279482:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273670272 00000100:00100000:0.0:1790945668.279534:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790945668.279543:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+19:15704:x1877942273670272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790945668.279811:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+19:15704:x1877942273670272:12345-0@lo:501:mount.lustre.0 Request processed in 268us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945668.279819:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790945668.279932:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273670272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790945668.279971:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273670400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790945668.280136:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.280238:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945668.280283:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273670400 00000100:00100000:0.0:1790945668.280288:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273670400 00000100:00100000:0.0:1790945668.280326:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790945668.280334:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+19:15704:x1877942273670400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790945668.280487:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+19:15704:x1877942273670400:12345-0@lo:503:mount.lustre.0 Request processed in 154us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945668.280764:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790945668.280873:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273670400:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790945668.282509:0:15704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790945668.282591:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273670528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790945668.282725:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.282812:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1790945668.288528:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273670528 00000100:00100000:0.0:1790945668.288544:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273670528 00000100:00100000:0.0:1790945668.288612:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790945668.288623:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+19:15704:x1877942273670528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790945668.289076:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+19:15704:x1877942273670528:12345-0@lo:502:mount.lustre.0 Request processed in 452us (6349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945668.289084:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790945668.289339:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273670528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790945668.289613:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790945668.289695:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790945668.289728:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790945668.289776:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790945668.289824:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790945668.289873:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790945668.290104:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790945668.290151:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790945668.290215:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790945668.290252:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790945668.290290:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790945668.290340:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790945668.290392:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790945668.290428:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790945668.290473:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790945668.290509:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790945668.290543:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790945668.290590:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790945668.290626:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790945668.290683:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790945668.290734:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790945668.290770:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790945668.290821:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790945668.290872:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790945668.291229:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790945668.291265:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790945668.291313:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790945668.291346:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790945668.291735:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790945668.291790:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790945668.291837:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790945668.291868:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790945668.292085:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790945668.292221:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790945668.292262:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790945668.292311:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790945668.292345:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790945668.292450:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790945668.292504:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790945668.292540:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790945668.292592:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273670656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790945668.292687:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.292724:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273670656 00000100:00100000:2.0:1790945668.292730:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273670656 00000100:00100000:2.0:1790945668.292776:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790945668.292784:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+19:15704:x1877942273670656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790945668.293329:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+19:15704:x1877942273670656:12345-0@lo:502:mount.lustre.0 Request processed in 545us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945668.293338:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790945668.294259:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843e9ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945668.294288:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c930380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273670656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790945668.294703:0:15704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1790945668.294718:0:15704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1790945668.298229:0:15715:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790945668.298247:0:15715:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bb87b4799c0) 00000020:00000080:1.0:1790945668.298268:0:15715:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1790945668.298348:0:15715:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bb850a71800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790945668.298352:0:15715:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bb850a71800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790945668.298355:0:15715:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bb850a71800 3 00010000:00080000:1.0:1790945668.298391:0:15715:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bb850a91800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.148@tcp at head 00010000:00010000:1.0:1790945668.299940:0:15715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1790945668.301874:0:15715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790945668.301928:0:15715:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790945668.301954:0:15715:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc5cf2c2a6a55048d 00000100:00080000:0.0:1790945668.301966:0:15715:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790945668.302105:0:15715:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bb850a91800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1790945668.302453:0:15715:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87b375500 x1877942273670784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790945668.302493:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1877942273670784:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790945668.302565:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945668.302633:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273670784 00000100:00100000:0.0:1790945668.302641:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273670784 00000100:00100000:0.0:1790945668.302689:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790945668.302697:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3291:x1877942273670784:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790945668.302722:0:14306:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:0.0:1790945668.302760:0:14306:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc5cf2c2a6a550494 00000004:00100000:0.0:1790945668.302776:0:14306:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790945668.302820:0:14306:0:(import.c:65:import_set_state_nolock()) ffff9bb74122c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790945668.302873:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1877942273670784:12345-0@lo:38:llog_process_th.0 Request processed in 175us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945668.303920:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790945668.303991:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb87b375500 x1877942273670784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790945678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790945668.304001:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790945668.304009:0:3291:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1790945668.304016:0:3291:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790945668.304020:0:3291:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790945668.304022:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb850a91800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790945668.304029:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3291:1877942273670784:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1790945668.304051:0:15715:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790945668.305366:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790945668.305372:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790945668.305376:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bb865e73800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790945668.305382:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:3.0:1790945668.305387:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790945668.305397:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bb865e73800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1790945668.305416:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87fe00e00 x1877942273671040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790945668.305471:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273671296:0@lo:400:kworker.0 00000100:00100000:3.0:1790945668.305474:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945668.305483:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273670912:0@lo:400:kworker.0 00000100:00100000:2.0:1790945668.306184:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.306224:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790945668.306238:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273671168:0@lo:400:kworker.0 00000100:00100000:2.0:1790945668.306263:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.306293:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273671296 00000100:00100000:2.0:1790945668.306300:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273671296 00000100:00100000:2.0:1790945668.306337:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273671168 00000100:00100000:2.0:1790945668.306339:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273671168 00000100:00100000:2.0:1790945668.306355:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790945668.306362:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273671296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945668.306424:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1877942273671296:12345-0@lo:400:kworker.0 Request processed in 61us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945668.306431:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790945668.306446:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790945668.306452:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273671168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945668.306475:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273671168:12345-0@lo:400:kworker.0 Request processed in 24us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945668.306481:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1790945668.306511:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb87fe01c00 x1877942273671168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945668.306522:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273671168:0@lo:400:kworker.0 00010000:00080000:2.0:1790945668.306532:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bb87fe01500 x1877942273671296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790945668.306539:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1877942273671296:0@lo:400:kworker.0 00000100:00100000:3.0:1790945668.307436:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945668.307492:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273671040:0@lo:8:kworker.0 00000100:00100000:3.0:1790945668.307543:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945668.307570:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273670912 00000100:00100000:2.0:1790945668.307575:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273670912 00000100:00100000:2.0:1790945668.307699:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273671040 00000100:00100000:2.0:1790945668.307703:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273671040 00000100:00100000:0.0:1790945668.307908:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790945668.307920:0:14989:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3294:x1877942273670912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945668.307968:0:14989:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3294:x1877942273670912:12345-0@lo:400:kworker.0 Request processed in 51us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945668.308102:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790945668.308121:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790945668.308125:0:14989:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3291:x1877942273671040:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790945668.308185:0:14989:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3291:x1877942273671040:12345-0@lo:8:kworker.0 Request processed in 58us (642us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790945668.308192:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790945668.311144:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273670912:0@lo:400:kworker.0 00000100:00100000:3.0:1790945668.311190:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790945668.311197:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb865e73800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790945668.311201:0:3291:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790945668.311205:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273671040:0@lo:8:kworker.0 00000040:00080000:2.0:1790945668.311778:0:15715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1790945668.311860:0:15704:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1790945668.311889:0:15704:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790945668.311911:0:15704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865430a00/0xc5cf2c2a6a550478 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55047f expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.311932:0:15704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865430a00/0xc5cf2c2a6a550478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55047f expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790945668.311977:0:15704:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790945668.311979:0:15704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790945668.311981:0:15704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945668.311982:0:15704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790945668.311983:0:15704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945668.311985:0:15704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945668.311986:0:15704:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790945668.311988:0:15704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945668.311989:0:15704:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790945668.311993:0:15704:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1790945668.311996:0:15704:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790945668.311997:0:15704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790945668.311999:0:15704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945668.312000:0:15704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790945668.312001:0:15704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945668.312002:0:15704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945668.312003:0:15704:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790945668.312004:0:15704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945668.312005:0:15704:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790945668.312028:0:15704:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790945668.312049:0:15704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273671424:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790945668.312126:0:15704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945668.312163:0:15704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8582e7540 going to sleep for 11 seconds 00000100:00100000:2.0:1790945668.314079:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273671424 00000100:00100000:2.0:1790945668.314090:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273671424 00000100:00100000:2.0:1790945668.314259:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790945668.314271:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+19:15704:x1877942273671424:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790945668.314301:0:14297:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790945668.314315:0:14297:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790945668.357746:0:14297:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790945668.357767:0:14297:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790945668.358601:0:14320:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790945668.358609:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790945668.358634:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.358679:0:14320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb865431400/0xc5cf2c2a6a55036e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550367 expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.358707:0:14320:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.358749:0:14320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb865431400/0xc5cf2c2a6a55036e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a550367 expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.358765:0:14320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb865431400/0xc5cf2c2a6a55036e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a550367 expref: 19 pid: 14298 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945668.358780:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1877942273671552:0@lo:104: 00000100:00100000:3.0:1790945668.358855:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945668.358912:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb86c96bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790945668.358940:0:14287:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273671552 00000100:00100000:3.0:1790945668.358948:0:14287:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273671552 00000100:00100000:3.0:1790945668.358998:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790945668.359014:0:14287:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2ac65209-3704-434c-a055-442590f14168+3:14320:x1877942273671552:12345-0@lo:104: 00010000:00010000:3.0:1790945668.359026:0:14287:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a55036e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.359076:0:14287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790945668.359082:0:14287:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2ac65209-3704-434c-a055-442590f14168+3:14320:x1877942273671552:12345-0@lo:104: Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945668.359089:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790945668.359114:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945668.359120:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a55036e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.359127:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133c00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1790945668.359137:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a55036e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.359156:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a55036e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945668.359163:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a55036e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945668.359170:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790945668.359201:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a55036e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.359207:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790945668.359227:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a55036e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.359234:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb87b133c00/0xc5cf2c2a6a550367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a55036e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.359254:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945668.359256:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945668.359257:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945668.359275:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ac65209-3704-434c-a055-442590f14168:3294:1877942273671680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945668.359303:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945668.359350:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1877942273671552:0@lo:104: 00010000:00010000:3.0:1790945668.359369:0:14320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945668.362119:0:14291:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273671680 00000100:00100000:2.0:1790945668.362133:0:14291:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273671680 00010000:00010000:2.0:1790945668.362182:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb865431400/0xc5cf2c2a6a55036e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a550367 expref: 20 pid: 14298 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945668.362226:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945668.362234:0:14291:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ac65209-3704-434c-a055-442590f14168+20:3294:x1877942273671680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945668.362249:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945668.362254:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb865431400/0xc5cf2c2a6a55036e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a550367 expref: 20 pid: 14298 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.362266:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb865431400/0xc5cf2c2a6a55036e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a550367 expref: 20 pid: 14298 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.362285:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865431400/0xc5cf2c2a6a55036e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a550367 expref: 20 pid: 14298 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.362303:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.362312:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790945668.362328:0:14291:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003720064s 00010000:00010000:2.0:1790945668.362346:0:14291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.362353:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.362360:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.362366:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.362529:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945668.362535:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.362544:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.362562:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945668.362572:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945668.362647:0:14291:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ac65209-3704-434c-a055-442590f14168+19:3294:x1877942273671680:12345-0@lo:103:ldlm_bl.0 Request processed in 413us (3343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945668.362680:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790945668.362760:0:14320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.362774:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945668.362780:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb8821c5000/0xc5cf2c2a6a55049b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945668.362869:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ac65209-3704-434c-a055-442590f14168:3294:1877942273671680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945668.371543:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+18:15704:x1877942273671424:12345-0@lo:253:mount.lustre.0 Request processed in 57264us (59406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945668.371559:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790945668.371768:0:15704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ac65209-3704-434c-a055-442590f14168:15704:1877942273671424:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790945668.371785:0:15704:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790945668.371789:0:15704:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790945668.371790:0:15704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790945668.371800:0:15704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790945668.371801:0:15704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790945668.371802:0:15704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790945668.371804:0:15704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790945668.371805:0:15704:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790945668.371807:0:15704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790945668.371809:0:15704:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790945668.371825:0:15704:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790945668.379583:0:15704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790945668.380101:0:15704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790945668.380338:0:15704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790945668.380581:0:15704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790945668.380852:0:15704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790945668.381295:0:15704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790945668.382596:0:15704:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1790945668.440892:0:15704:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790945668.440901:0:15704:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790945668.440929:0:15704:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790945668.440987:0:15704:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790945668.441003:0:15704:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1790945668.441031:0:15704:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1790945668.580174:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790945669.409301:0:14301:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790945669.409308:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bb87390c000 from 8 10000000:01000000:1.0:1790945669.409319:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790945669.409364:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a5504a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945669.409375:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a5504a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945669.409387:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a5504a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945669.409413:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273671808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790945669.409480:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945669.409576:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843851e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790945669.413430:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273671808 00000100:00100000:3.0:1790945669.413444:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273671808 00000100:00100000:3.0:1790945669.413492:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790945669.413499:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+18:14301:x1877942273671808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945669.413515:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945669.413531:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb8821c5800/0xc5cf2c2a6a5504a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a5504a2 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945669.413553:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb8821c5800/0xc5cf2c2a6a5504a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5504a2 expref: 19 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945669.413561:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb8821c5800/0xc5cf2c2a6a5504a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5504a2 expref: 19 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945669.413573:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb8821c5800, rc 0) 00000100:00100000:3.0:1790945669.413636:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+19:14301:x1877942273671808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (4157us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945669.413643:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790945669.414232:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273671808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790945669.414253:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a5504a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5504a9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945669.414263:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a5504a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a5504a9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945669.414331:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273671936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790945669.414373:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945669.414418:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843851e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790945669.414486:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273671936 00000100:00100000:2.0:1790945669.414491:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273671936 00000100:00100000:2.0:1790945669.414526:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790945669.414534:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+19:14301:x1877942273671936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790945669.414549:0:14298:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790945669.414563:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790945669.414566:0:14298:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1790945669.414644:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+19:14301:x1877942273671936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945669.414651:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790945669.414700:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273671936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790945669.414754:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790945669.414760:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a5504a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5504a9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945669.414768:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb84167bc00/0xc5cf2c2a6a5504a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a5504a9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945669.598140:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790945670.518221:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1790945670.518300:0:6695:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1790945670.620452:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945671.650493:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945672.667956:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945672.987901:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273672064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945672.987976:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945672.989159:0:14991:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273672064 00000100:00100000:2.0:1790945672.989171:0:14991:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273672064 00000100:00100000:2.0:1790945672.989339:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945672.989350:0:14991:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273672064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945672.989386:0:14991:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945672.989463:0:14991:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273672064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945672.989477:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1790945672.989503:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945672.989519:0:3295:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790945672.989543:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273672064:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790945673.499791:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790945673.499798:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790945673.499802:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bb865e73800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1790945673.499802:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273672192:0@lo:400:kworker.0 00000100:00080000:3.0:1790945673.499817:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bb865e73800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1790945673.499836:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bb87fe01c00 x1877942273672448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790945673.499873:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945673.499907:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273672320:0@lo:400:kworker.0 00000100:00100000:3.0:1790945673.499937:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945673.499942:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273672832:0@lo:400:kworker.0 00000100:00100000:3.0:1790945673.499968:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273672448:0@lo:8:kworker.0 00000100:00100000:1.0:1790945673.499969:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945673.499989:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945673.499996:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273672576:0@lo:400:kworker.0 00000100:00100000:1.0:1790945673.500016:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945673.500024:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273672704:0@lo:400:kworker.0 00000100:00100000:3.0:1790945673.500044:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945673.500044:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273672192 00000100:00100000:1.0:1790945673.500051:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273672192 00000100:00100000:3.0:1790945673.500068:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273672320 00000100:00100000:3.0:1790945673.500072:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273672320 00000100:00100000:3.0:1790945673.500098:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273672448 00000100:00100000:3.0:1790945673.500101:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273672448 00000100:00100000:3.0:1790945673.500113:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945673.500121:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273672320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945673.500178:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273672320:12345-0@lo:400:kworker.0 Request processed in 57us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945673.500186:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790945673.500204:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790945673.500208:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3291:x1877942273672448:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1790945673.500215:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790945673.500221:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb88146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+19:3292:x1877942273672192:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1790945673.500231:0:14987:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 419 last 0 00000100:00100000:1.0:1790945673.500254:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb88146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+19:3292:x1877942273672192:12345-0@lo:400:kworker.0 Request processed in 34us (381us total) trans 0 rc 0/0 00000020:00000080:3.0:1790945673.500257:0:14987:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc5cf2c2a6a5504b0 00000100:00100000:1.0:1790945673.500259:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00002000:00100000:3.0:1790945673.500270:0:14987:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bb842f1a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1790945673.500274:0:14987:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1790945673.500277:0:14987:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1790945673.500285:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273672832 00000100:00100000:1.0:1790945673.500288:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273672832 00000100:00100000:1.0:1790945673.500316:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273672576 00000100:00100000:1.0:1790945673.500319:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273672576 00000100:00100000:1.0:1790945673.500327:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273672704 00000100:00100000:1.0:1790945673.500329:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273672704 00000100:00100000:1.0:1790945673.500340:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790945673.500345:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273672832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945673.500371:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273672832:12345-0@lo:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945673.500377:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790945673.500386:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790945673.500391:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273672576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945673.500419:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273672576:12345-0@lo:400:kworker.0 Request processed in 28us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945673.500425:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790945673.500443:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790945673.500449:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273672704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945673.500479:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1877942273672704:12345-0@lo:400:kworker.0 Request processed in 31us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945673.500485:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1790945673.500505:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:3.0:1790945673.500620:0:14987:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790945673.500642:0:14987:0:(import.c:65:import_set_state_nolock()) ffff9bb842f19800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790945673.500696:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1877942273672448:12345-0@lo:8:kworker.0 Request processed in 485us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945673.500701:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790945673.500755:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87fe01f80 x1877942273672704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945673.500768:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1877942273672704:0@lo:400:kworker.0 00010000:00080000:3.0:1790945673.500795:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87fe01c00 x1877942273672448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790945698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790945673.500806:0:3291:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790945673.500813:0:3291:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790945673.500818:0:3291:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790945673.500820:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9bb865e73800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790945673.500835:0:3291:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790945673.500847:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3291:1877942273672448:0@lo:8:kworker.0 00000004:00080000:3.0:1790945673.500882:0:14329:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000004:00080000:1.0:1790945673.500892:0:14328:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1790945673.500895:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14329:1877942273673088:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790945673.500919:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945673.500935:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843003180 going to sleep for 11 seconds 00000100:00100000:3.0:1790945673.500947:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87fe01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273672960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945673.500969:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945673.500992:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273672320:0@lo:400:kworker.0 00000100:00100000:3.0:1790945673.501015:0:14991:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273672960 00000100:00100000:3.0:1790945673.501019:0:14991:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273672960 00000100:00100000:3.0:1790945673.501047:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790945673.501053:0:14991:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273672960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790945673.501071:0:14991:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790945673.501105:0:14991:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273672960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945673.501111:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790945673.501135:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87fe01c00 x1877942273672960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790945689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790945673.501148:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273672960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945673.501161:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273673088 00000100:00100000:3.0:1790945673.501164:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273673088 00000100:00100000:3.0:1790945673.501181:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790945673.501186:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14329:x1877942273673088:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1790945673.501222:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790945673.501240:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87fe02d80 x1877942273672576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945673.501249:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273672576:0@lo:400:kworker.0 00000004:00080000:1.0:1790945673.501568:0:14328:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419296910174ns, next at 0ns, rc = 0 00010000:00080000:1.0:1790945673.501641:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bb87fe02680 x1877942273672832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790945689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790945673.501651:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273672832:0@lo:400:kworker.0 00000100:00100000:1.0:1790945673.501679:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273672192:0@lo:400:kworker.0 00002000:00080000:3.0:1790945673.511984:0:14987:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1790945673.511995:0:14987:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1790945673.512006:0:14987:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1790945673.528776:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.528789:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011e3c2c5/0xc5cf2c2a6a5504b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.528807:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.528812:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.528820:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011e3c2c5/0xc5cf2c2a6a5504b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.528842:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011e3c2c5/0xc5cf2c2a6a5504b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.528852:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011e3c2c5/0xc5cf2c2a6a5504b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.528860:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011e3c2c5/0xc5cf2c2a6a5504b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.528879:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945673.528893:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945673.528899:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011e3c2c5/0xc5cf2c2a6a5504b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.528907:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945673.528912:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011e3c2c5/0xc5cf2c2a6a5504b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.528934:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011e3c2c5/0xc5cf2c2a6a5504b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.528951:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011e3c2c5/0xc5cf2c2a6a5504b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.528959:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011e3c2c5/0xc5cf2c2a6a5504b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.528979:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.528981:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.528983:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.529467:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.529473:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071bd55e8/0xc5cf2c2a6a5504be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.529483:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.529487:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.529491:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071bd55e8/0xc5cf2c2a6a5504be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.529501:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071bd55e8/0xc5cf2c2a6a5504be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.529510:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071bd55e8/0xc5cf2c2a6a5504be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.529524:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071bd55e8/0xc5cf2c2a6a5504be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.529548:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945673.530087:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945673.530095:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071bd55e8/0xc5cf2c2a6a5504be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.530106:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5a00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.530110:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071bd55e8/0xc5cf2c2a6a5504be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.530120:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071bd55e8/0xc5cf2c2a6a5504be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.530139:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071bd55e8/0xc5cf2c2a6a5504be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.530148:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071bd55e8/0xc5cf2c2a6a5504be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.530168:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.530170:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.530172:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.532609:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.532621:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5504c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.532637:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.532642:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.532647:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5504c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.532679:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5504c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.532690:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5504c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.532699:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5504c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.532718:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945673.532731:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945673.532737:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5504c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.532760:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c4000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945673.532765:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5504c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.532775:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5504c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.532791:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5504c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.532797:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d62650ef/0xc5cf2c2a6a5504c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.532817:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.532820:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.532822:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.535277:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.535290:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bed9ba91/0xc5cf2c2a6a5504cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.535307:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.535312:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.535318:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bed9ba91/0xc5cf2c2a6a5504cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.535332:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bed9ba91/0xc5cf2c2a6a5504cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.535348:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bed9ba91/0xc5cf2c2a6a5504cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.535356:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bed9ba91/0xc5cf2c2a6a5504cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.535380:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945673.535400:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945673.535409:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bed9ba91/0xc5cf2c2a6a5504cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.535432:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0d600 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.535437:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bed9ba91/0xc5cf2c2a6a5504cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.535448:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bed9ba91/0xc5cf2c2a6a5504cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.535468:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bed9ba91/0xc5cf2c2a6a5504cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.535476:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bed9ba91/0xc5cf2c2a6a5504cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.535501:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.535504:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.535506:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.535846:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.535853:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.535862:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.535865:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.535869:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.535879:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.535887:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.535894:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.537010:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945673.537025:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945673.537032:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.537042:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0ca00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945673.537047:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.537057:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.537073:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.537148:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.537171:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.537173:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.537175:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.537643:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.537650:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d09cfff9/0xc5cf2c2a6a5504da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.537689:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.537700:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.537705:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d09cfff9/0xc5cf2c2a6a5504da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.537718:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d09cfff9/0xc5cf2c2a6a5504da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.537727:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d09cfff9/0xc5cf2c2a6a5504da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.537735:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d09cfff9/0xc5cf2c2a6a5504da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.537759:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790945673.537907:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945673.537914:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d09cfff9/0xc5cf2c2a6a5504da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945673.537922:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0cc00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945673.537926:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d09cfff9/0xc5cf2c2a6a5504da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945673.537934:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d09cfff9/0xc5cf2c2a6a5504da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945673.537950:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d09cfff9/0xc5cf2c2a6a5504da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945673.537957:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d09cfff9/0xc5cf2c2a6a5504da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945673.537984:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945673.537986:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945673.537988:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.539395:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.539405:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a5504e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.539425:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.539429:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.539435:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a5504e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.539447:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a5504e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.539457:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a5504e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.539473:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a5504e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.539495:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790945673.539531:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945673.539538:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a5504e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945673.539546:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0c200 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945673.539550:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a5504e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945673.539559:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a5504e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945673.539574:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a5504e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945673.539582:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a5504e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945673.539601:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945673.539603:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945673.539606:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.542308:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.542323:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a5504e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.542339:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.542343:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.542349:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a5504e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.542363:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a5504e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.542372:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a5504e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.542380:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a5504e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.542404:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790945673.543515:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.543525:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a5504ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.543543:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.543547:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.543552:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a5504ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.543564:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a5504ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.543572:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a5504ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.543580:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a5504ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.543599:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790945673.543610:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790945673.543617:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a5504e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.543625:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0c800 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945673.543630:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a5504e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.543639:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a5504e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.543888:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a5504e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.543896:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a5504e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.543914:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945673.543917:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a5504ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.543979:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0d000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945673.543983:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a5504ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.543990:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a5504ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.543999:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a5504ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.544006:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a5504ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.544018:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.544019:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.544026:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.544188:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.550596:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.550609:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.550628:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.550633:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.550639:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.550654:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.550680:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.550688:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.550708:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945673.550719:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945673.550725:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.550733:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0ca00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945673.550737:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.550769:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.550786:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.550793:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a5504f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.550811:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.550813:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.550815:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.551480:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.551488:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a5504fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.551497:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.551501:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.551505:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a5504fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.551513:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a5504fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.551520:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a5504fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.551533:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a5504fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.551546:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945673.552250:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945673.552259:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a5504fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.552269:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0d800 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.552274:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a5504fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.552295:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a5504fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.552310:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a5504fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.552318:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a5504fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.552336:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.552338:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.552340:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.552815:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.552822:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550504 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.552834:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.552838:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.552844:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.552854:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.552862:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.552870:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.552887:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945673.552899:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945673.552904:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.553475:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0de00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945673.553481:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.553490:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.553504:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550504 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.553512:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550504 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.553530:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.553532:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.553534:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.555577:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.555589:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade91f1a/0xc5cf2c2a6a55050b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.555606:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.555610:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.555616:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade91f1a/0xc5cf2c2a6a55050b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.555630:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ade91f1a/0xc5cf2c2a6a55050b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.555646:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade91f1a/0xc5cf2c2a6a55050b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.555654:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ade91f1a/0xc5cf2c2a6a55050b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.558990:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945673.559283:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945673.559292:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ade91f1a/0xc5cf2c2a6a55050b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.559302:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0d400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.559308:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade91f1a/0xc5cf2c2a6a55050b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.559319:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade91f1a/0xc5cf2c2a6a55050b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.559338:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ade91f1a/0xc5cf2c2a6a55050b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.559356:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ade91f1a/0xc5cf2c2a6a55050b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.559379:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.559381:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.559383:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.559638:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.559645:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a550512 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.559674:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.559679:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.559686:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a550512 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.559700:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a550512 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.559711:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a550512 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.559719:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a550512 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.559757:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945673.559768:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945673.559774:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a550512 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.559781:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0dc00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945673.559785:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a550512 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.559793:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a550512 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.559805:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a550512 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.559813:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a550512 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.559830:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.559832:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.559833:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.560243:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.560250:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1597ebf/0xc5cf2c2a6a550519 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560259:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.560268:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.560273:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1597ebf/0xc5cf2c2a6a550519 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560284:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1597ebf/0xc5cf2c2a6a550519 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560292:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1597ebf/0xc5cf2c2a6a550519 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560302:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1597ebf/0xc5cf2c2a6a550519 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560377:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00100000:1.0:1790945673.560404:0:7627:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1790945673.560845:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.560852:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f86c135c/0xc5cf2c2a6a550520 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560862:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.560866:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.560870:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f86c135c/0xc5cf2c2a6a550520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560880:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f86c135c/0xc5cf2c2a6a550520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560889:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f86c135c/0xc5cf2c2a6a550520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560903:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f86c135c/0xc5cf2c2a6a550520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560917:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790945673.560925:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790945673.560930:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1597ebf/0xc5cf2c2a6a550519 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560936:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0ce00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945673.560940:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1597ebf/0xc5cf2c2a6a550519 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560948:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1597ebf/0xc5cf2c2a6a550519 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560960:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1597ebf/0xc5cf2c2a6a550519 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560968:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1597ebf/0xc5cf2c2a6a550519 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.560982:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945673.560985:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f86c135c/0xc5cf2c2a6a550520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561002:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0c600 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945673.561005:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86c135c/0xc5cf2c2a6a550520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561014:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86c135c/0xc5cf2c2a6a550520 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561025:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f86c135c/0xc5cf2c2a6a550520 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561032:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f86c135c/0xc5cf2c2a6a550520 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561046:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.561048:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.561050:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.561448:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.561455:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8b45b99/0xc5cf2c2a6a550527 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561464:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.561467:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.561471:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8b45b99/0xc5cf2c2a6a550527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561482:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8b45b99/0xc5cf2c2a6a550527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561496:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8b45b99/0xc5cf2c2a6a550527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561503:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8b45b99/0xc5cf2c2a6a550527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561518:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790945673.561528:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945673.561533:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8b45b99/0xc5cf2c2a6a550527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561541:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0d200 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945673.561544:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8b45b99/0xc5cf2c2a6a550527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561552:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8b45b99/0xc5cf2c2a6a550527 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561565:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8b45b99/0xc5cf2c2a6a550527 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561572:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8b45b99/0xc5cf2c2a6a550527 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.561589:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.561597:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945673.561599:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.561891:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.565593:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.565605:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a55052e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.565623:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.565627:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.565634:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a55052e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.565648:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a55052e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.565675:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a55052e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.565684:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a55052e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.565704:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945673.566139:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945673.566147:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a55052e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.566159:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0dc00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.566164:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a55052e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.566176:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a55052e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.566194:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a55052e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.566203:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f6050d3/0xc5cf2c2a6a55052e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.566224:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.566226:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.566235:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790945673.566934:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1790945673.569287:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.569299:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550535 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.569316:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.569320:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.569326:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.569347:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.569358:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.569366:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.569389:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945673.569423:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945673.569432:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.569442:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0de00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.569447:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.569457:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.569476:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550535 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.569484:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0b537f6/0xc5cf2c2a6a550535 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.569519:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.569521:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.569523:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.571356:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.571367:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a55053c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.571383:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.571387:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.571393:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a55053c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.571406:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a55053c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.572022:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a55053c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.572045:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a55053c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.572062:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945673.572548:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945673.572555:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a55053c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.572565:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0ca00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.572569:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a55053c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.572602:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a55053c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.572621:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a55053c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.572629:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2e97b5/0xc5cf2c2a6a55053c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.572653:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.572669:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.572671:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.575397:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.575411:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a550543 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.575525:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.575530:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.575538:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a550543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.575553:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a550543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.575565:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a550543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.575574:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a550543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.575603:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945673.575776:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945673.575784:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a550543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.575794:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0d000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.575799:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a550543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.575809:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a550543 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.575827:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a550543 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.575847:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a550543 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.575876:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.575879:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.575881:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.577378:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.577390:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a55054a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.577412:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.578016:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.578023:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a55054a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.578039:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a55054a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.578049:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a55054a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.578058:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a55054a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.578154:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945673.578252:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945673.578260:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a55054a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.578270:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0c800 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.578275:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a55054a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.578328:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a55054a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.578348:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a55054a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.578356:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b3b3d29/0xc5cf2c2a6a55054a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.578384:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.578387:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.578389:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.584173:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.584188:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a86671c0/0xc5cf2c2a6a550551 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.584206:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.584211:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.584218:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a86671c0/0xc5cf2c2a6a550551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.584234:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a86671c0/0xc5cf2c2a6a550551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.584260:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a86671c0/0xc5cf2c2a6a550551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.584270:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a86671c0/0xc5cf2c2a6a550551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.584298:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945673.584763:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945673.584771:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a86671c0/0xc5cf2c2a6a550551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.584781:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0c000 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.584786:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a86671c0/0xc5cf2c2a6a550551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.584796:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a86671c0/0xc5cf2c2a6a550551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.584813:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a86671c0/0xc5cf2c2a6a550551 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.584821:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a86671c0/0xc5cf2c2a6a550551 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.584843:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.584844:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.584846:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.586306:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.586318:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026b733d1/0xc5cf2c2a6a550558 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.586334:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.586339:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.586346:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026b733d1/0xc5cf2c2a6a550558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.586359:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026b733d1/0xc5cf2c2a6a550558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.586369:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026b733d1/0xc5cf2c2a6a550558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.586378:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026b733d1/0xc5cf2c2a6a550558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.586674:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945673.587168:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945673.587176:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026b733d1/0xc5cf2c2a6a550558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.587187:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0c400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.587192:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026b733d1/0xc5cf2c2a6a550558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.587216:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026b733d1/0xc5cf2c2a6a550558 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.587234:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026b733d1/0xc5cf2c2a6a550558 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.587243:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026b733d1/0xc5cf2c2a6a550558 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.587269:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.587270:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.587272:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.590267:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.590281:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048f84344/0xc5cf2c2a6a55055f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.590299:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.590303:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.590309:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048f84344/0xc5cf2c2a6a55055f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.590322:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048f84344/0xc5cf2c2a6a55055f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.590331:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048f84344/0xc5cf2c2a6a55055f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.590338:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048f84344/0xc5cf2c2a6a55055f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.590365:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790945673.590938:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.590945:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a550566 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.590954:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.590963:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.590967:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a550566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.590977:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a550566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.590986:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a550566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.590993:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a550566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.591008:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790945673.591197:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790945673.591206:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048f84344/0xc5cf2c2a6a55055f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591215:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0da00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.591220:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048f84344/0xc5cf2c2a6a55055f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591230:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048f84344/0xc5cf2c2a6a55055f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591248:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048f84344/0xc5cf2c2a6a55055f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591267:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048f84344/0xc5cf2c2a6a55055f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591290:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945673.591294:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a550566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591301:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0d800 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.591304:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a550566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591311:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a550566 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591323:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a550566 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591330:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000901b71e7/0xc5cf2c2a6a550566 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591344:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.591346:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.591347:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.591353:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790945673.591424:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790945673.591430:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a55056d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.591438:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1790945673.591441:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945673.591445:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a55056d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.591454:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a55056d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.591461:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a55056d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.591476:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a55056d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945673.591495:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790945673.591573:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945673.591580:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a55056d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591594:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0c200 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945673.591598:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a55056d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591607:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a55056d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591619:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a55056d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591626:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fba065f/0xc5cf2c2a6a55056d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945673.591647:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.591650:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945673.591653:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1790945673.591719:0:14987:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1790945673.591829:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14329:x1877942273673088:12345-0@lo:5:osp-pre-1-0.0 Request processed in 90637us (90903us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945673.591839:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790945673.591901:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87fe01f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14329:1877942273673088:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1790945673.591917:0:14329:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1790945673.591961:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b379f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14329:1877942273673216:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790945673.591994:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945673.592035:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8654ab540 going to sleep for 11 seconds 00000100:00100000:0.0:1790945673.592128:0:14989:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273673216 00000100:00100000:0.0:1790945673.592135:0:14989:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273673216 00000100:00100000:0.0:1790945673.592231:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790945673.592250:0:14989:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14329:x1877942273673216:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1790945673.592288:0:14989:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1790945673.608122:0:14989:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14329:x1877942273673216:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15869us (16120us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790945673.608151:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790945673.608250:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b379f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14329:1877942273673216:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790945673.608268:0:14329:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1790945673.695263:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790945674.013449:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1790945674.310087:0:16064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790945674.720324:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945675.739909:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945676.186219:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945676.186306:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254803840 00000100:00100000:3.0:1790945676.186317:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254803840 00000100:00100000:3.0:1790945676.186362:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 75 00000100:00100000:3.0:1790945676.186371:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2369:x1877942254803840:12345-192.168.202.48@tcp:250:mount.lustre.0 00010000:00080000:3.0:1790945676.186399:0:14297:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0498e5a3-7601-4041-84f4-4c7941c69f16@192.168.202.48@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:3.0:1790945676.186427:0:14297:0:(genops.c:1384:class_connect()) connect: client 0498e5a3-7601-4041-84f4-4c7941c69f16, cookie 0xc5cf2c2a6a550574 00000100:00080000:3.0:1790945676.186578:0:14297:0:(import.c:65:import_set_state_nolock()) ffff9bb842f1c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790945676.186778:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+5:2369:x1877942254803840:12345-192.168.202.48@tcp:250:mount.lustre.0 Request processed in 405us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945676.186786:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 75 00000100:00100000:1.0:1790945676.207000:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945676.207129:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254803968 00000100:00100000:2.0:1790945676.207141:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254803968 00000100:00100000:2.0:1790945676.207203:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 76 00000100:00100000:2.0:1790945676.207213:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+5:13718:x1877942254803968:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790945676.207230:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945676.207247:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865431c00/0xc5cf2c2a6a55057b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c84ef expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945676.207292:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865431c00/0xc5cf2c2a6a55057b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84ef expref: 6 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945676.207302:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865431c00/0xc5cf2c2a6a55057b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84ef expref: 6 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945676.207311:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431c00, rc 0) 00000100:00100000:2.0:1790945676.207375:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+6:13718:x1877942254803968:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 163us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945676.207382:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 76 00000100:00100000:2.0:1790945676.226430:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945676.226777:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254804096 00000100:00100000:1.0:1790945676.226788:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254804096 00000100:00100000:1.0:1790945676.226889:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 77 00000100:00100000:1.0:1790945676.226910:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb85109a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+6:13718:x1877942254804096:12345-192.168.202.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790945676.228438:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb85109a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+6:13718:x1877942254804096:12345-192.168.202.48@tcp:501:mount.lustre.0 Request processed in 1532us (2010us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790945676.228447:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 77 00000100:00100000:1.0:1790945676.236973:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945676.237189:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254804224 00000100:00100000:0.0:1790945676.237198:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254804224 00000100:00100000:0.0:1790945676.237255:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 78 00000100:00100000:0.0:1790945676.237266:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+6:13718:x1877942254804224:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790945676.237282:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945676.237300:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865d1d800/0xc5cf2c2a6a550582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c84f6 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945676.237329:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1d800/0xc5cf2c2a6a550582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84f6 expref: 7 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945676.237340:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865d1d800/0xc5cf2c2a6a550582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c84f6 expref: 7 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945676.237349:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d800, rc 0) 00000100:00100000:0.0:1790945676.237404:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+7:13718:x1877942254804224:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 140us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945676.237412:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 78 00000100:00100000:3.0:1790945676.239179:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945676.239256:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254804352 00000100:00100000:1.0:1790945676.239263:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254804352 00000100:00100000:1.0:1790945676.239299:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00100000:1.0:1790945676.239308:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+7:13718:x1877942254804352:12345-192.168.202.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790945676.239583:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+8:13718:x1877942254804352:12345-192.168.202.48@tcp:501:mount.lustre.0 Request processed in 275us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945676.239589:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00100000:2.0:1790945676.241706:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945676.241804:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254804480 00000100:00100000:0.0:1790945676.241812:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254804480 00000100:00100000:0.0:1790945676.241909:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 80 00000100:00100000:0.0:1790945676.241929:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb851099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+8:13718:x1877942254804480:12345-192.168.202.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790945676.242299:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb851099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+8:13718:x1877942254804480:12345-192.168.202.48@tcp:503:mount.lustre.0 Request processed in 381us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945676.242306:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 80 00000100:00100000:3.0:1790945676.246000:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945676.246829:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254804608 00000100:00100000:2.0:1790945676.246839:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254804608 00000100:00100000:2.0:1790945676.246881:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:2.0:1790945676.246890:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb85109bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+8:13736:x1877942254804608:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790945676.247607:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb85109bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+8:13736:x1877942254804608:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 715us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945676.247616:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:3.0:1790945676.256826:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945676.256965:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254804736 00000100:00100000:0.0:1790945676.256976:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254804736 00000100:00100000:0.0:1790945676.257033:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 82 00000100:00100000:0.0:1790945676.257043:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+8:13736:x1877942254804736:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790945676.257317:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+8:13736:x1877942254804736:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 274us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945676.257326:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 82 00000100:00100000:1.0:1790945676.260385:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945676.260486:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254804864 00000100:00100000:2.0:1790945676.260498:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254804864 00000100:00100000:2.0:1790945676.260558:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00100000:2.0:1790945676.260568:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+8:13718:x1877942254804864:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790945676.260584:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945676.260600:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865431a00/0xc5cf2c2a6a550589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8520 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945676.260642:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865431a00/0xc5cf2c2a6a550589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8520 expref: 9 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945676.260652:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865431a00/0xc5cf2c2a6a550589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8520 expref: 9 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945676.260692:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431a00, rc 0) 00000100:00100000:2.0:1790945676.260783:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+9:13718:x1877942254804864:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 216us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945676.260790:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00100000:3.0:1790945676.267325:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945676.267442:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254804992 00000100:00100000:2.0:1790945676.267453:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254804992 00000100:00100000:2.0:1790945676.267514:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 84 00000100:00100000:2.0:1790945676.267525:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+9:13718:x1877942254804992:12345-192.168.202.48@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790945676.267552:0:14299:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790945676.267576:0:14299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790945676.267581:0:14299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790945676.267584:0:14299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790945676.267586:0:14299:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1790945676.272985:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+9:13718:x1877942254804992:12345-192.168.202.48@tcp:256:mount.lustre.0 Request processed in 5450us (5659us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945676.273001:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 84 00000100:00100000:3.0:1790945676.281120:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945676.281323:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254805120 00000100:00100000:0.0:1790945676.281334:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254805120 00000100:00100000:0.0:1790945676.281386:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00100000:0.0:1790945676.281394:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+9:13718:x1877942254805120:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790945676.281410:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945676.281426:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865d1d600/0xc5cf2c2a6a550590 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8527 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945676.281457:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1d600/0xc5cf2c2a6a550590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8527 expref: 10 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945676.281467:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865d1d600/0xc5cf2c2a6a550590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8527 expref: 10 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945676.281476:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1d600, rc 0) 00000100:00100000:0.0:1790945676.281530:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+10:13718:x1877942254805120:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 137us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945676.281541:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00100000:3.0:1790945676.283647:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945676.283771:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254805248 00000100:00100000:2.0:1790945676.283779:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254805248 00000100:00100000:2.0:1790945676.283863:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 86 00000100:00100000:2.0:1790945676.283872:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+10:13718:x1877942254805248:12345-192.168.202.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790945676.284297:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+10:13718:x1877942254805248:12345-192.168.202.48@tcp:501:mount.lustre.0 Request processed in 425us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945676.284306:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 86 00000100:00100000:3.0:1790945676.285911:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945676.286057:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254805376 00000100:00100000:1.0:1790945676.286065:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254805376 00000100:00100000:1.0:1790945676.286116:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 87 00000100:00100000:1.0:1790945676.286125:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+10:13718:x1877942254805376:12345-192.168.202.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790945676.286446:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+10:13718:x1877942254805376:12345-192.168.202.48@tcp:503:mount.lustre.0 Request processed in 321us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945676.286461:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 87 00000100:00100000:3.0:1790945676.288874:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945676.289057:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254805504 00000100:00100000:2.0:1790945676.289066:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254805504 00000100:00100000:2.0:1790945676.289111:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 88 00000100:00100000:2.0:1790945676.289117:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+10:13741:x1877942254805504:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790945676.289332:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+10:13741:x1877942254805504:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 214us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945676.289338:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 88 00000100:00100000:3.0:1790945676.296023:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945676.296797:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254805632 00000100:00100000:0.0:1790945676.296810:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254805632 00000100:00100000:0.0:1790945676.296864:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 89 00000100:00100000:0.0:1790945676.296874:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+10:13741:x1877942254805632:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790945676.297119:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+10:13741:x1877942254805632:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 245us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945676.297127:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 89 00000100:00100000:2.0:1790945676.304360:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945676.305878:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254805760 00000100:00100000:1.0:1790945676.305891:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254805760 00000100:00100000:1.0:1790945676.306078:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:1.0:1790945676.306086:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2369:x1877942254805760:12345-192.168.202.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790945676.306119:0:15011:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e1d81a00-9000-4eda-ab02-47a5c184b1ba@192.168.202.48@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:1.0:1790945676.306166:0:15011:0:(genops.c:1384:class_connect()) connect: client e1d81a00-9000-4eda-ab02-47a5c184b1ba, cookie 0xc5cf2c2a6a550597 00000004:00100000:1.0:1790945676.306197:0:15011:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1790945676.306203:0:15011:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1790945676.338426:0:15011:0:(import.c:65:import_set_state_nolock()) ffff9bb74122c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790945676.338532:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:2369:x1877942254805760:12345-192.168.202.48@tcp:38:mount.lustre.0 Request processed in 32445us (34180us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945676.338540:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:3.0:1790945676.342099:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945676.342142:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945676.342239:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254806016 00000100:00100000:1.0:1790945676.342248:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254806016 00000100:00100000:1.0:1790945676.342357:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254805888 00000100:00100000:1.0:1790945676.342359:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254805888 00000100:00080000:3.0:1790945676.342415:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945676.342485:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:0.0:1790945676.342494:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:13718:x1877942254806016:12345-192.168.202.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790945676.342533:0:14304:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790945676.342644:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:13718:x1877942254806016:12345-192.168.202.48@tcp:41:mount.lustre.0 Request processed in 150us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945676.342652:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:0.0:1790945676.342697:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:0.0:1790945676.342704:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:0:x1877942254805888:12345-192.168.202.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790945676.342726:0:14304:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790945676.342751:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:0:x1877942254805888:12345-192.168.202.48@tcp:41:mount.lustre.0 Request processed in 48us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945676.342775:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:2.0:1790945676.348110:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945676.348405:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254806144 00000100:00100000:0.0:1790945676.348416:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254806144 00000100:00100000:0.0:1790945676.348479:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:0.0:1790945676.348490:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:13718:x1877942254806144:12345-192.168.202.48@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790945676.348648:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:13718:x1877942254806144:12345-192.168.202.48@tcp:40:mount.lustre.0 Request processed in 161us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945676.348654:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:3.0:1790945676.352270:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945676.352317:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945676.352428:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945676.352740:0:14307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254806528 00000100:00100000:2.0:1790945676.352749:0:14307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254806528 00000100:00100000:2.0:1790945676.352805:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:2.0:1790945676.352814:0:14307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:13718:x1877942254806528:12345-192.168.202.48@tcp:33:mount.lustre.0 00000100:00100000:1.0:1790945676.353117:0:14990:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254806272 00000100:00100000:1.0:1790945676.353122:0:14990:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254806272 00000100:00100000:1.0:1790945676.353227:0:14990:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254806400 00000100:00100000:1.0:1790945676.353230:0:14990:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254806400 00000100:00100000:1.0:1790945676.353240:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:1.0:1790945676.353245:0:14990:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2369:x1877942254806272:12345-192.168.202.48@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790945676.353264:0:14990:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e1d81a00-9000-4eda-ab02-47a5c184b1ba@192.168.202.48@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:1.0:1790945676.353291:0:14990:0:(genops.c:1384:class_connect()) connect: client e1d81a00-9000-4eda-ab02-47a5c184b1ba, cookie 0xc5cf2c2a6a55059e 00002000:00100000:1.0:1790945676.353299:0:14990:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e1d81a00-9000-4eda-ab02-47a5c184b1ba/ffff9bb850a94800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790945676.353316:0:14990:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790945676.353560:0:14990:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790945676.353587:0:14990:0:(import.c:65:import_set_state_nolock()) ffff9bb850a96000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790945676.353649:0:14990:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:2369:x1877942254806272:12345-192.168.202.48@tcp:8:mount.lustre.0 Request processed in 403us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945676.353682:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:1.0:1790945676.353696:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:1.0:1790945676.353699:0:14990:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2369:x1877942254806400:12345-192.168.202.48@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790945676.353710:0:14990:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e1d81a00-9000-4eda-ab02-47a5c184b1ba@192.168.202.48@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:1.0:1790945676.353735:0:14990:0:(genops.c:1384:class_connect()) connect: client e1d81a00-9000-4eda-ab02-47a5c184b1ba, cookie 0xc5cf2c2a6a5505a5 00002000:00100000:1.0:1790945676.353740:0:14990:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e1d81a00-9000-4eda-ab02-47a5c184b1ba/ffff9bb850a95000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790945676.353752:0:14990:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790945676.353853:0:14990:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790945676.353866:0:14990:0:(import.c:65:import_set_state_nolock()) ffff9bb850a93000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790945676.353885:0:14990:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:2369:x1877942254806400:12345-192.168.202.48@tcp:8:mount.lustre.0 Request processed in 184us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945676.353892:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9 00000004:00080000:0.0:1790945676.355244:0:14307:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2374us 00000004:00200000:0.0:1790945676.366364:0:14307:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790945676.366471:0:14307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:13718:x1877942254806528:12345-192.168.202.48@tcp:33:mount.lustre.0 Request processed in 13652us (14037us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945676.366482:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:3.0:1790945676.543058:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945676.543122:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254806656 00000100:00100000:1.0:1790945676.543132:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254806656 00000100:00100000:1.0:1790945676.543250:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:1.0:1790945676.543261:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87fe02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:13762:x1877942254806656:12345-192.168.202.48@tcp:101:mkdir.0 00010000:00010000:1.0:1790945676.543282:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945676.543307:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b600/0xc5cf2c2a6a5505ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8551 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945676.543373:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167ba00/0xc5cf2c2a6a5505b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945676.543388:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167ba00/0xc5cf2c2a6a5505b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945676.543420:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167ba00/0xc5cf2c2a6a5505b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945676.543456:0:14305:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790945676.543459:0:14305:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790945676.543493:0:14305:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167ba00/0xc5cf2c2a6a5505b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945676.543517:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b600/0xc5cf2c2a6a5505ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8551 expref: 8 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945676.543534:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167ba00/0xc5cf2c2a6a5505b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8551 expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945676.543544:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb852834900) 00010000:00010000:1.0:1790945676.543546:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790945676.543549:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167ba00, rc 0) 00000100:00100000:1.0:1790945676.543608:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87fe02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:13762:x1877942254806656:12345-192.168.202.48@tcp:101:mkdir.0 Request processed in 349us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945676.543614:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8 00010000:00010000:2.0:1790945676.763903:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945677.787914:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945678.107980:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790945678.108008:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273673344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945678.108086:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945678.108138:0:14991:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273673344 00000100:00100000:2.0:1790945678.108146:0:14991:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273673344 00000100:00080000:3.0:1790945678.108169:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945678.108207:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945678.108218:0:14991:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273673344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945678.108242:0:14991:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945678.108292:0:14991:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273673344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.108299:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790945678.108441:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273673344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945678.592710:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945678.594266:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254806784 00000100:00100000:0.0:1790945678.594279:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254806784 00000100:00100000:0.0:1790945678.594376:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:0.0:1790945678.594388:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:13814:x1877942254806784:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:0.0:1790945678.594433:0:15011:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790945678.594537:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:13814:x1877942254806784:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 151us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945678.594546:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00080000:3.0:1790945678.594641:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945678.607563:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945678.607755:0:14992:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254806912 00000100:00100000:2.0:1790945678.607766:0:14992:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254806912 00000100:00100000:2.0:1790945678.607836:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:2.0:1790945678.607847:0:14992:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:13814:x1877942254806912:12345-192.168.202.48@tcp:13:lfs.0 00000100:00080000:3.0:1790945678.607953:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1790945678.608144:0:14992:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945678.608240:0:14992:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:13814:x1877942254806912:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 394us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.608248:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:2.0:1790945678.610553:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945678.612055:0:14991:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254807040 00000100:00100000:0.0:1790945678.612070:0:14991:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254807040 00000100:00100000:0.0:1790945678.612166:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:0.0:1790945678.612180:0:14991:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:13814:x1877942254807040:12345-192.168.202.48@tcp:13:lfs.0 00000100:00080000:3.0:1790945678.612228:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1790945678.612231:0:14991:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945678.612322:0:14991:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:13814:x1877942254807040:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 147us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945678.612330:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:2.0:1790945678.620159:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945678.620183:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ac65209-3704-434c-a055-442590f14168:3294:1877942273673472:0@lo:400:kworker.0 00000100:00100000:2.0:1790945678.620261:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945678.620406:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273673728:0@lo:400:kworker.0 00000100:00100000:3.0:1790945678.620438:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945678.620460:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790945678.620467:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273673600:0@lo:400:kworker.0 00000100:00100000:3.0:1790945678.620488:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945678.620505:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273674112:0@lo:400:kworker.0 00000100:00100000:3.0:1790945678.620552:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945678.620584:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273674112 00000100:00100000:3.0:1790945678.620592:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273674112 00000100:00100000:3.0:1790945678.620643:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790945678.620652:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273674112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945678.620736:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273674112:12345-0@lo:400:kworker.0 Request processed in 85us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945678.620744:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1790945678.620766:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945678.620778:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273673856:0@lo:400:kworker.0 00000100:00100000:3.0:1790945678.620800:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945678.620819:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790945678.620824:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273673984:0@lo:400:kworker.0 00000100:00100000:3.0:1790945678.620861:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945678.621211:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273674112:0@lo:400:kworker.0 00000100:00100000:2.0:1790945678.621236:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273673728 00000100:00100000:2.0:1790945678.621240:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273673728 00000100:00100000:2.0:1790945678.621279:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273673600 00000100:00100000:2.0:1790945678.621282:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273673600 00000100:00100000:2.0:1790945678.621299:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945678.621307:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273673728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945678.621340:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790945678.621351:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273674240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945678.621417:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273673472 00000100:00100000:1.0:1790945678.621422:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273673472 00000100:00100000:1.0:1790945678.621449:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790945678.621456:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+19:3294:x1877942273673472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945678.626085:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1877942273673728:12345-0@lo:400:kworker.0 Request processed in 4769us (5635us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.626101:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790945678.626136:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790945678.626149:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273673600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945678.626213:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273673600:12345-0@lo:400:kworker.0 Request processed in 70us (5724us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.626237:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1790945678.626321:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790945678.626355:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273673856 00000100:00100000:2.0:1790945678.626362:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273673856 00000100:00100000:2.0:1790945678.626400:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273673984 00000100:00100000:2.0:1790945678.626403:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273673984 00000100:00100000:2.0:1790945678.626429:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790945678.626436:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273673856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945678.626470:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273673856:12345-0@lo:400:kworker.0 Request processed in 35us (5669us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.626476:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790945678.626488:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790945678.626494:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273673984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945678.626522:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273673984:12345-0@lo:400:kworker.0 Request processed in 29us (5661us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.626528:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1790945678.626541:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790945678.626648:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273673600:0@lo:400:kworker.0 00000100:00100000:2.0:1790945678.626686:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273673728:0@lo:400:kworker.0 00000100:00100000:3.0:1790945678.634910:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273673984:0@lo:400:kworker.0 00000100:00100000:3.0:1790945678.634932:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273673856:0@lo:400:kworker.0 00000100:00100000:0.0:1790945678.635040:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945678.635113:0:14992:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273674240 00000100:00100000:0.0:1790945678.635121:0:14992:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273674240 00000100:00100000:0.0:1790945678.635170:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790945678.635181:0:14992:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1877942273674240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945678.635206:0:14992:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945678.635265:0:14992:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1877942273674240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945678.635273:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790945678.635329:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273674240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945678.636480:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+19:3294:x1877942273673472:12345-0@lo:400:kworker.0 Request processed in 15010us (16205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945678.636509:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790945678.637130:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ac65209-3704-434c-a055-442590f14168:3294:1877942273673472:0@lo:400:kworker.0 00000001:00080000:2.0:1790945678.721341:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1790945678.721362:0:7627:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e1d81a00-9000-4eda-ab02-47a5c184b1ba 00010000:00010000:2.0:1790945678.816072:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945678.833191:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945678.833290:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254807168 00000100:00100000:0.0:1790945678.833301:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254807168 00000100:00100000:0.0:1790945678.833358:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 91 00000100:00100000:0.0:1790945678.833369:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+10:13845:x1877942254807168:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790945678.833386:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945678.833404:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865d1c000/0xc5cf2c2a6a5505ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8558 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945678.833432:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1c000/0xc5cf2c2a6a5505ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8558 expref: 11 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945678.833462:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865d1c000/0xc5cf2c2a6a5505ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8558 expref: 11 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945678.833471:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1c000, rc 0) 00000100:00100000:0.0:1790945678.833537:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+11:13845:x1877942254807168:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 170us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945678.833544:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 91 00000100:00100000:3.0:1790945678.842359:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945678.842727:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254807296 00000100:00100000:1.0:1790945678.842737:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254807296 00000100:00100000:1.0:1790945678.842799:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 92 00000100:00100000:1.0:1790945678.842809:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+11:13845:x1877942254807296:12345-192.168.202.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790945678.843754:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+11:13845:x1877942254807296:12345-192.168.202.48@tcp:501:mount.lustre.0 Request processed in 944us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945678.843764:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 92 00000100:00100000:1.0:1790945678.863284:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945678.863754:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254807424 00000100:00100000:2.0:1790945678.863766:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254807424 00000100:00100000:2.0:1790945678.863857:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 93 00000100:00100000:2.0:1790945678.863867:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+11:13845:x1877942254807424:12345-192.168.202.48@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790945678.864483:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+11:13845:x1877942254807424:12345-192.168.202.48@tcp:503:mount.lustre.0 Request processed in 615us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.864494:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 93 00000100:00100000:0.0:1790945678.873340:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945678.873577:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254807552 00000100:00100000:1.0:1790945678.873589:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254807552 00000100:00100000:1.0:1790945678.873639:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 94 00000100:00100000:1.0:1790945678.873649:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+11:13853:x1877942254807552:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790945678.874010:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+11:13853:x1877942254807552:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 362us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945678.874019:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 94 00000100:00100000:3.0:1790945678.899411:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945678.899806:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254807680 00000100:00100000:2.0:1790945678.899817:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254807680 00000100:00100000:2.0:1790945678.899878:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 95 00000100:00100000:2.0:1790945678.899888:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+11:13853:x1877942254807680:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790945678.900594:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+11:13853:x1877942254807680:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 704us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.900604:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 95 00000100:00100000:2.0:1790945678.915551:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945678.915637:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254807808 00000100:00100000:3.0:1790945678.915647:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254807808 00000100:00100000:2.0:1790945678.916007:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 96 00000100:00100000:2.0:1790945678.916018:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+11:13845:x1877942254807808:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790945678.916036:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945678.916055:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865431400/0xc5cf2c2a6a5505c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8582 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945678.916149:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865431400/0xc5cf2c2a6a5505c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8582 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945678.916161:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865431400/0xc5cf2c2a6a5505c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8582 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945678.916170:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431400, rc 0) 00000100:00100000:2.0:1790945678.916231:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+12:13845:x1877942254807808:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 215us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.916253:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 96 00000100:00100000:0.0:1790945678.919510:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945678.919610:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254807936 00000100:00100000:2.0:1790945678.919621:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254807936 00000100:00100000:0.0:1790945678.919827:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 97 00000100:00100000:0.0:1790945678.919840:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+12:13845:x1877942254807936:12345-192.168.202.48@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790945678.919867:0:14297:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790945678.919907:0:14297:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790945678.919912:0:14297:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790945678.919915:0:14297:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790945678.919917:0:14297:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1790945678.922606:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+12:13845:x1877942254807936:12345-192.168.202.48@tcp:256:mount.lustre.0 Request processed in 2758us (3093us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945678.922621:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 97 00000100:00100000:1.0:1790945678.929530:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945678.929634:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254808064 00000100:00100000:2.0:1790945678.929644:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254808064 00000100:00100000:2.0:1790945678.929739:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 98 00000100:00100000:2.0:1790945678.929749:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+12:13845:x1877942254808064:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790945678.929766:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945678.929785:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865430200/0xc5cf2c2a6a5505c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8589 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945678.929815:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865430200/0xc5cf2c2a6a5505c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8589 expref: 13 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945678.929826:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865430200/0xc5cf2c2a6a5505c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8589 expref: 13 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945678.929835:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865430200, rc 0) 00000100:00100000:2.0:1790945678.929911:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13845:x1877942254808064:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 156us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.929919:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 98 00000100:00100000:1.0:1790945678.934946:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945678.937046:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254808192 00000100:00100000:0.0:1790945678.937062:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254808192 00000100:00100000:0.0:1790945678.937130:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 99 00000100:00100000:0.0:1790945678.937141:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13845:x1877942254808192:12345-192.168.202.48@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790945678.937432:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13845:x1877942254808192:12345-192.168.202.48@tcp:501:mount.lustre.0 Request processed in 292us (2493us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945678.937451:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 99 00000100:00100000:3.0:1790945678.939810:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945678.940089:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254808320 00000100:00100000:0.0:1790945678.940099:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254808320 00000100:00100000:0.0:1790945678.940154:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 100 00000100:00100000:0.0:1790945678.940164:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13845:x1877942254808320:12345-192.168.202.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790945678.940380:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13845:x1877942254808320:12345-192.168.202.48@tcp:503:mount.lustre.0 Request processed in 217us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945678.940392:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 100 00000100:00100000:1.0:1790945678.947140:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945678.947404:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254808448 00000100:00100000:2.0:1790945678.947416:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254808448 00000100:00100000:2.0:1790945678.947473:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 101 00000100:00100000:2.0:1790945678.947484:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13857:x1877942254808448:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790945678.947778:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13857:x1877942254808448:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 295us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.947795:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 101 00000100:00100000:1.0:1790945678.951119:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945678.951830:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254808576 00000100:00100000:2.0:1790945678.951842:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254808576 00000100:00100000:2.0:1790945678.952009:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 102 00000100:00100000:2.0:1790945678.952022:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13857:x1877942254808576:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790945678.952290:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13857:x1877942254808576:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 269us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.958348:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 102 00000100:00100000:3.0:1790945678.960632:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945678.962507:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254808704 00000100:00100000:2.0:1790945678.962523:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254808704 00000100:00100000:2.0:1790945678.962591:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:2.0:1790945678.962600:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2369:x1877942254808704:12345-192.168.202.48@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790945678.962631:0:15011:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 76100aa7-c8ca-49bd-af68-2804246b11f7@192.168.202.48@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:2.0:1790945678.962715:0:15011:0:(genops.c:1384:class_connect()) connect: client 76100aa7-c8ca-49bd-af68-2804246b11f7, cookie 0xc5cf2c2a6a5505cf 00000004:00100000:2.0:1790945678.962744:0:15011:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790945678.962864:0:15011:0:(import.c:65:import_set_state_nolock()) ffff9bb7433b4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945678.963040:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76100aa7-c8ca-49bd-af68-2804246b11f7+6:2369:x1877942254808704:12345-192.168.202.48@tcp:38:mount.lustre.0 Request processed in 437us (2418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.963049:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:1.0:1790945678.967027:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945678.967246:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254808832 00000100:00100000:2.0:1790945678.967256:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254808832 00000100:00100000:2.0:1790945678.967340:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:2.0:1790945678.967350:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+6:0:x1877942254808832:12345-192.168.202.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790945678.967378:0:14305:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790945678.967469:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+6:0:x1877942254808832:12345-192.168.202.48@tcp:41:mount.lustre.0 Request processed in 120us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.967477:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00080000:0.0:1790945678.967707:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945678.969350:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945678.970094:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254808960 00000100:00100000:3.0:1790945678.970113:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254808960 00000100:00100000:3.0:1790945678.970193:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:3.0:1790945678.970226:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76100aa7-c8ca-49bd-af68-2804246b11f7+6:13845:x1877942254808960:12345-192.168.202.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790945678.970269:0:14306:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790945678.970374:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76100aa7-c8ca-49bd-af68-2804246b11f7+6:13845:x1877942254808960:12345-192.168.202.48@tcp:41:mount.lustre.0 Request processed in 152us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945678.970382:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:2.0:1790945678.981212:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945678.981335:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254809088 00000100:00100000:1.0:1790945678.981349:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254809088 00000100:00100000:1.0:1790945678.981455:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:1.0:1790945678.981467:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+6:13845:x1877942254809088:12345-192.168.202.48@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790945678.981570:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+6:13845:x1877942254809088:12345-192.168.202.48@tcp:40:mount.lustre.0 Request processed in 105us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945678.981578:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:1.0:1790945678.987176:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945678.987228:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945678.987337:0:14989:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254809216 00000100:00100000:3.0:1790945678.987353:0:14989:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254809216 00000100:00100000:3.0:1790945678.987403:0:14989:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254809344 00000100:00100000:3.0:1790945678.987407:0:14989:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254809344 00000100:00100000:3.0:1790945678.987423:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:3.0:1790945678.987432:0:14989:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2369:x1877942254809216:12345-192.168.202.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790945678.987473:0:14989:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 76100aa7-c8ca-49bd-af68-2804246b11f7@192.168.202.48@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:3.0:1790945678.987623:0:14989:0:(genops.c:1384:class_connect()) connect: client 76100aa7-c8ca-49bd-af68-2804246b11f7, cookie 0xc5cf2c2a6a5505d6 00002000:00100000:3.0:1790945678.987640:0:14989:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 76100aa7-c8ca-49bd-af68-2804246b11f7/ffff9bb86559f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790945678.987654:0:14989:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790945678.987863:0:14989:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790945678.989028:0:14989:0:(import.c:65:import_set_state_nolock()) ffff9bb8519f6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945678.989141:0:14989:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+6:2369:x1877942254809216:12345-192.168.202.48@tcp:8:mount.lustre.0 Request processed in 1704us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.989153:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:2.0:1790945678.989193:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:2.0:1790945678.989200:0:14989:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2369:x1877942254809344:12345-192.168.202.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790945678.989230:0:14989:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 76100aa7-c8ca-49bd-af68-2804246b11f7@192.168.202.48@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:2.0:1790945678.989263:0:14989:0:(genops.c:1384:class_connect()) connect: client 76100aa7-c8ca-49bd-af68-2804246b11f7, cookie 0xc5cf2c2a6a5505dd 00002000:00100000:2.0:1790945678.989276:0:14989:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 76100aa7-c8ca-49bd-af68-2804246b11f7/ffff9bb7433b5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790945678.989286:0:14989:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790945678.989512:0:14989:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790945678.989536:0:14989:0:(import.c:65:import_set_state_nolock()) ffff9bb7433b3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790945678.989562:0:14989:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+6:2369:x1877942254809344:12345-192.168.202.48@tcp:8:mount.lustre.0 Request processed in 361us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945678.989568:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:3.0:1790945678.991365:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945678.991479:0:14308:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254809472 00000100:00100000:1.0:1790945678.991488:0:14308:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254809472 00000100:00100000:1.0:1790945678.991538:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:1.0:1790945678.991548:0:14308:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+6:13845:x1877942254809472:12345-192.168.202.48@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790945678.991624:0:14308:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790945678.991977:0:14308:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+6:13845:x1877942254809472:12345-192.168.202.48@tcp:33:mount.lustre.0 Request processed in 352us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945678.991987:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:0.0:1790945679.220285:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945679.220834:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254809600 00000100:00100000:2.0:1790945679.220845:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254809600 00000100:00100000:2.0:1790945679.220953:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:2.0:1790945679.220963:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76100aa7-c8ca-49bd-af68-2804246b11f7+6:13878:x1877942254809600:12345-192.168.202.48@tcp:101:mkdir.0 00010000:00010000:2.0:1790945679.220983:0:15011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945679.221006:0:15011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a5505e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c85b3 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945679.221078:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5505eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945679.221091:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5505eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945679.221106:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5505eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945679.221140:0:15011:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790945679.221144:0:15011:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945679.221163:0:15011:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5505eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945679.221188:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a5505e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85b3 expref: 8 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945679.221205:0:15011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5505eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85b3 expref: 7 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945679.221212:0:15011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb852834900) 00010000:00010000:2.0:1790945679.221215:0:15011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945679.221219:0:15011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865430600, rc 0) 00000100:00100000:2.0:1790945679.221285:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76100aa7-c8ca-49bd-af68-2804246b11f7+7:13878:x1877942254809600:12345-192.168.202.48@tcp:101:mkdir.0 Request processed in 323us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945679.221293:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14 00010000:00010000:3.0:1790945679.835894:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790945680.738041:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e1d81a00-9000-4eda-ab02-47a5c184b1ba 00000001:00100000:1.0:1790945680.738061:0:6695:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76100aa7-c8ca-49bd-af68-2804246b11f7 00010000:00010000:3.0:1790945680.862137:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790945681.755950:0:5846:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e1d81a00-9000-4eda-ab02-47a5c184b1ba 00000001:00100000:1.0:1790945681.756088:0:5846:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 76100aa7-c8ca-49bd-af68-2804246b11f7 00010000:00010000:2.0:1790945681.885682:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790945682.444104:0:16269:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1790945682.908438:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945683.228771:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273674368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790945683.228862:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945683.229122:0:14992:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273674368 00000100:00100000:2.0:1790945683.229144:0:14992:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273674368 00000100:00100000:2.0:1790945683.229212:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790945683.229222:0:14992:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273674368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945683.229257:0:14992:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945683.229326:0:14992:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273674368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945683.229334:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790945683.229478:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273674368:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790945683.229611:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945683.741691:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790945683.741714:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273674496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945683.741797:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945683.741874:0:14992:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273674496 00000100:00100000:0.0:1790945683.741882:0:14992:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273674496 00000100:00100000:0.0:1790945683.741938:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790945683.741959:0:14992:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273674496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945683.741996:0:14992:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790945683.742042:0:14992:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273674496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945683.742048:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790945683.742069:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790945683.742096:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1790945683.742117:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273674496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945683.744715:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273674752:0@lo:400:kworker.0 00000100:00100000:0.0:1790945683.744814:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945683.745045:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273674624:0@lo:400:kworker.0 00000100:00100000:3.0:1790945683.745083:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945683.745143:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273675008:0@lo:400:kworker.0 00000100:00100000:0.0:1790945683.746126:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273674752 00000100:00100000:0.0:1790945683.746137:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273674752 00000100:00100000:0.0:1790945683.746267:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790945683.746276:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87516ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273674752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945683.746334:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87516ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1877942273674752:12345-0@lo:400:kworker.0 Request processed in 59us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945683.746342:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790945683.746368:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273674624 00000100:00100000:0.0:1790945683.746371:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273674624 00000100:00100000:0.0:1790945683.746406:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790945683.746414:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+19:3292:x1877942273674624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790945683.746450:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+19:3292:x1877942273674624:12345-0@lo:400:kworker.0 Request processed in 38us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945683.746456:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790945683.746494:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273674880:0@lo:400:kworker.0 00000100:00100000:0.0:1790945683.746520:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945683.746566:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1877942273674752:0@lo:400:kworker.0 00000100:00100000:3.0:1790945683.747351:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273674880 00000100:00100000:3.0:1790945683.747358:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273674880 00000100:00100000:3.0:1790945683.747413:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790945683.747422:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87516b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273674880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945683.747473:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87516b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273674880:12345-0@lo:400:kworker.0 Request processed in 52us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945683.747479:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790945683.747505:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945683.747537:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273675008 00000100:00100000:3.0:1790945683.747540:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273675008 00000100:00100000:3.0:1790945683.747561:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790945683.747567:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273675008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945683.747600:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1877942273675008:12345-0@lo:400:kworker.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945683.747606:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790945683.747637:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1877942273675008:0@lo:400:kworker.0 00000100:00100000:3.0:1790945683.747701:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273674624:0@lo:400:kworker.0 00000100:00080000:0.0:1790945683.748241:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790945683.748266:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273674880:0@lo:400:kworker.0 00000001:00100000:3.0:1790945683.833686:0:7627:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76100aa7-c8ca-49bd-af68-2804246b11f7 00010000:00010000:3.0:1790945683.932401:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945684.122529:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945684.122601:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945684.122628:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945684.122702:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945684.122725:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945684.122738:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945684.122784:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945684.122893:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254810240 00000100:00100000:3.0:1790945684.122902:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254810240 00000100:00100000:3.0:1790945684.122964:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254809856 00000100:00100000:3.0:1790945684.122967:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254809856 00000100:00100000:3.0:1790945684.122996:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 19 00000100:00100000:3.0:1790945684.123005:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb875169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76100aa7-c8ca-49bd-af68-2804246b11f7+6:2370:x1877942254810240:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945684.123084:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb875169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76100aa7-c8ca-49bd-af68-2804246b11f7+6:2370:x1877942254810240:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 80us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945684.123092:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 19 00000100:00100000:3.0:1790945684.123107:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 20 00000100:00100000:3.0:1790945684.123113:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb875168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:2370:x1877942254809856:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945684.123132:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb875168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:2370:x1877942254809856:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 19us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945684.123138:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 20 00000100:00080000:0.0:1790945684.123449:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945684.123526:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254809984 00000100:00100000:3.0:1790945684.123530:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254809984 00000100:00100000:3.0:1790945684.123590:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254810496 00000100:00100000:3.0:1790945684.123594:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254810496 00000100:00100000:1.0:1790945684.123613:0:14990:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254810112 00000100:00100000:1.0:1790945684.123618:0:14990:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254810112 00000100:00100000:2.0:1790945684.123626:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254809728 00000100:00100000:2.0:1790945684.123630:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254809728 00000100:00100000:2.0:1790945684.123685:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 104 00000100:00100000:2.0:1790945684.123692:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87af26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+13:2370:x1877942254809728:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945684.123723:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87af26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+13:2370:x1877942254809728:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 33us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945684.123730:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 104 00000100:00100000:2.0:1790945684.123768:0:14989:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254810368 00000100:00100000:2.0:1790945684.123772:0:14989:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254810368 00000100:00080000:0.0:1790945684.123856:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945684.123859:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945684.123932:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:3.0:1790945684.123948:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87516bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2370:x1877942254809984:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945684.123972:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87516bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2370:x1877942254809984:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945684.123978:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:3.0:1790945684.123998:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:3.0:1790945684.124004:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb875169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+5:2370:x1877942254810496:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945684.124022:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb875169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+5:2370:x1877942254810496:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 19us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945684.124028:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:2.0:1790945684.127615:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:2.0:1790945684.127629:0:14989:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb875169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+5:2370:x1877942254810368:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945684.127723:0:14989:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb875169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+5:2370:x1877942254810368:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 98us (4937us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945684.127731:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:1.0:1790945684.130549:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:1.0:1790945684.130565:0:14990:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb875169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2370:x1877942254810112:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945684.130669:0:14990:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb875169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2370:x1877942254810112:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 95us (7915us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945684.130691:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7 00000040:00080000:1.0:1790945684.252920:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790945684.959048:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945685.981701:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790945686.195619:0:16418:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff8a66ea0 20000000:00000080:3.0:1790945686.195647:0:16418:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bb741f8dc00 uarg=0000000000000000 20000000:01000000:3.0:1790945686.195911:0:16418:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790945686.195917:0:16418:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790945686.195923:0:16418:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790945686.196924:0:16419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1790945686.197101:0:16418:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790945686.205452:0:16418:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790945686.205525:0:16418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.205547:0:16418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb865431600/0xc5cf2c2a6a5502e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a5502e2 expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.205555:0:16418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb865431800/0xc5cf2c2a6a550336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a55032f expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.205561:0:16418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb865d1ca00/0xc5cf2c2a6a550471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a55046a expref: 18 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.205570:0:16418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb865d1d600/0xc5cf2c2a6a550590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8527 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.205578:0:16418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bb865430200/0xc5cf2c2a6a5505c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8589 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.205585:0:16418:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.205641:0:16418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb865430200/0xc5cf2c2a6a5505c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8589 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.205697:0:16418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb865430200/0xc5cf2c2a6a5505c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8589 expref: 12 pid: 14298 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945686.205811:0:16418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881931880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16418:1877942273675136:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945686.205932:0:16418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb865d1d600/0xc5cf2c2a6a550590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8527 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.205941:0:16418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb865d1d600/0xc5cf2c2a6a550590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8527 expref: 12 pid: 14297 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945686.205950:0:16418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881932d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16418:1877942273675264:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945686.205979:0:16418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb865d1ca00/0xc5cf2c2a6a550471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a55046a expref: 18 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.205988:0:16418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb865d1ca00/0xc5cf2c2a6a550471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a55046a expref: 18 pid: 14299 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945686.205997:0:16418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881930700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16418:1877942273675392:0@lo:104: 00000100:00100000:3.0:1790945686.206038:0:16418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945686.206078:0:14288:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273675392 00000100:00100000:3.0:1790945686.206087:0:14288:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273675392 00000100:00100000:3.0:1790945686.206881:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790945686.206895:0:14288:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881933480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ac65209-3704-434c-a055-442590f14168+3:16418:x1877942273675392:12345-0@lo:104: 00010000:00010000:3.0:1790945686.206910:0:14288:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a550471 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.206972:0:14288:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790945686.206979:0:14288:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881933480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ac65209-3704-434c-a055-442590f14168+3:16418:x1877942273675392:12345-0@lo:104: Request processed in 90us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945686.206986:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1790945686.207049:0:16418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb865431800/0xc5cf2c2a6a550336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a55032f expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.207060:0:16418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb865431800/0xc5cf2c2a6a550336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a55032f expref: 18 pid: 14298 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945686.207072:0:16418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881930e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16418:1877942273675520:0@lo:104: 00000100:00100000:3.0:1790945686.207114:0:16418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790945686.207433:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945686.207441:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a550471 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.207450:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865431200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945686.207462:0:14293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a550471 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.207471:0:14293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a550471 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945686.207478:0:14293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a550471 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945686.207484:0:14293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790945686.207517:0:14293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a550471 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.207523:0:14293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945686.207546:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a550471 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.207553:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb865431200/0xc5cf2c2a6a55046a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a550471 expref: -99 pid: 15704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.207569:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945686.207571:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945686.207573:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945686.207593:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273675648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945686.207641:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945686.207798:0:14289:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273675648 00000100:00100000:2.0:1790945686.207811:0:14289:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273675648 00010000:00010000:2.0:1790945686.207836:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb865d1ca00/0xc5cf2c2a6a550471 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a55046a expref: 19 pid: 14299 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945686.207860:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790945686.207874:0:14289:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ac65209-3704-434c-a055-442590f14168+19:3292:x1877942273675648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945686.207884:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945686.207889:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9bb865d1ca00/0xc5cf2c2a6a550471 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a55046a expref: 19 pid: 14299 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.207899:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb865d1ca00/0xc5cf2c2a6a550471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a55046a expref: 19 pid: 14299 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.207915:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945686.207942:0:14289:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ac65209-3704-434c-a055-442590f14168+19:3292:x1877942273675648:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945686.207948:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790945686.207983:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273675648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945686.208470:0:14288:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273675520 00000100:00100000:3.0:1790945686.208475:0:14288:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273675520 00000100:00100000:3.0:1790945686.208503:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790945686.208510:0:14288:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb881933800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ac65209-3704-434c-a055-442590f14168+3:16418:x1877942273675520:12345-0@lo:104: 00010000:00010000:3.0:1790945686.208521:0:14288:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a550336 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.208563:0:14288:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790945686.208568:0:14288:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb881933800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ac65209-3704-434c-a055-442590f14168+3:16418:x1877942273675520:12345-0@lo:104: Request processed in 59us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945686.208575:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1790945686.208604:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790945686.208609:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a550336 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.208616:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb87b133800 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1790945686.208621:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a550336 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.208638:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a550336 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790945686.208675:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a550336 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945686.208680:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790945686.208707:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a550336 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.208715:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790945686.209430:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1790945686.209453:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a550336 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.209463:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb87b133800/0xc5cf2c2a6a55032f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a550336 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.209477:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945686.209479:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945686.209481:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790945686.209522:0:16418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bb865431600/0xc5cf2c2a6a5502e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc5cf2c2a6a5502e2 expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.209533:0:16418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bb865431600/0xc5cf2c2a6a5502e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc5cf2c2a6a5502e2 expref: 18 pid: 14297 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945686.209545:0:16418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16418:1877942273675904:0@lo:104: 00000100:00100000:3.0:1790945686.209586:0:16418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945686.209614:0:14288:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790945686.209635:0:14288:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273675904 00000100:00100000:3.0:1790945686.209639:0:14288:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273675904 00000100:00100000:3.0:1790945686.209694:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790945686.209711:0:14288:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8738ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ac65209-3704-434c-a055-442590f14168+3:16418:x1877942273675904:12345-0@lo:104: 00010000:00010000:3.0:1790945686.209734:0:14288:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a5502e9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.209773:0:14288:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790945686.209779:0:14288:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8738ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ac65209-3704-434c-a055-442590f14168+3:16418:x1877942273675904:12345-0@lo:104: Request processed in 70us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945686.209786:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790945686.209851:0:16418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843442840 going to sleep for 11 seconds 00010000:00010000:3.0:1790945686.209873:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865d1ca00/0xc5cf2c2a6a550471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a55046a expref: 18 pid: 14299 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945686.209884:0:16418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881930700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16418:1877942273675392:0@lo:104: 00000100:00100000:3.0:1790945686.209893:0:16418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881930e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16418:1877942273675520:0@lo:104: 00000100:00100000:3.0:1790945686.209899:0:16418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16418:1877942273675904:0@lo:104: 00010000:00010000:2.0:1790945686.210093:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790945686.210100:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc5cf2c2a6a5502e9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.210128:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb8821c5600 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1790945686.210133:0:14293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc5cf2c2a6a5502e9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.210140:0:14293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc5cf2c2a6a5502e9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790945686.210147:0:14293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc5cf2c2a6a5502e9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790945686.210153:0:14293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790945686.210188:0:14293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a5502e9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.210202:0:14293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790945686.210222:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a5502e9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.210229:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff9bb8821c5600/0xc5cf2c2a6a5502e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc5cf2c2a6a5502e9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.210246:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945686.210248:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790945686.210249:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945686.210262:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ac65209-3704-434c-a055-442590f14168:3294:1877942273676032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790945686.210297:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945686.210332:0:14290:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273676032 00000100:00100000:2.0:1790945686.210337:0:14290:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273676032 00010000:00010000:2.0:1790945686.210354:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb865431600/0xc5cf2c2a6a5502e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a5502e2 expref: 18 pid: 14297 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945686.210377:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790945686.210383:0:14290:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ac65209-3704-434c-a055-442590f14168+18:3294:x1877942273676032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945686.210393:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945686.210397:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb865431600/0xc5cf2c2a6a5502e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a5502e2 expref: 18 pid: 14297 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.210406:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb865431600/0xc5cf2c2a6a5502e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a5502e2 expref: 18 pid: 14297 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.210418:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865431600/0xc5cf2c2a6a5502e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a5502e2 expref: 18 pid: 14297 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.210440:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945686.210471:0:14290:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ac65209-3704-434c-a055-442590f14168+17:3294:x1877942273676032:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945686.210478:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790945686.210506:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ac65209-3704-434c-a055-442590f14168:3294:1877942273676032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945686.211044:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb881932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273675776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790945686.211077:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945686.211190:0:14291:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273675776 00000100:00100000:2.0:1790945686.211195:0:14291:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273675776 00010000:00010000:2.0:1790945686.211213:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb865431800/0xc5cf2c2a6a550336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a55032f expref: 17 pid: 14298 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945686.211244:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790945686.211251:0:14291:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87392e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ac65209-3704-434c-a055-442590f14168+17:3292:x1877942273675776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790945686.211260:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945686.211264:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bb865431800/0xc5cf2c2a6a550336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc5cf2c2a6a55032f expref: 17 pid: 14298 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.211272:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb865431800/0xc5cf2c2a6a550336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc5cf2c2a6a55032f expref: 17 pid: 14298 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.211285:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865431800/0xc5cf2c2a6a550336 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc5cf2c2a6a55032f expref: 17 pid: 14298 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945686.211295:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945686.211516:0:14291:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87392e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ac65209-3704-434c-a055-442590f14168+16:3292:x1877942273675776:12345-0@lo:103:ldlm_bl.0 Request processed in 265us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945686.211523:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790945686.211593:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ac65209-3704-434c-a055-442590f14168:3292:1877942273675776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790945686.232333:0:16418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881931880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16418:1877942273675136:192.168.202.48@tcp:104: 00000100:00100000:3.0:1790945686.232344:0:16418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb881932d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16418:1877942273675264:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945686.232382:0:16418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945686.234250:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945686.234341:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945686.237951:0:14290:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254810624 00000100:00100000:3.0:1790945686.237968:0:14290:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254810624 00010000:00010000:3.0:1790945686.238019:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb865430200/0xc5cf2c2a6a5505c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8589 expref: 13 pid: 14298 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945686.238053:0:14290:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254810752 00000100:00100000:3.0:1790945686.238056:0:14290:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254810752 00010000:00010000:3.0:1790945686.238067:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bb865d1d600/0xc5cf2c2a6a550590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8527 expref: 14 pid: 14297 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945686.238094:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:0.0:1790945686.238350:0:14291:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790945686.238360:0:14291:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1790945686.238554:0:14290:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87516a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0498e5a3-7601-4041-84f4-4c7941c69f16+14:2373:x1877942254810624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945686.238573:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945686.238579:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9bb865430200/0xc5cf2c2a6a5505c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8589 expref: 14 pid: 14298 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.238593:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb865430200/0xc5cf2c2a6a5505c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8589 expref: 14 pid: 14298 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.238611:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865430200/0xc5cf2c2a6a5505c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8589 expref: 14 pid: 14298 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.238637:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945686.238987:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:0.0:1790945686.238997:0:14291:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb875169500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0498e5a3-7601-4041-84f4-4c7941c69f16+13:2373:x1877942254810752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945686.239008:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945686.239014:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9bb865d1d600/0xc5cf2c2a6a550590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8527 expref: 13 pid: 14297 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945686.239024:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bb865d1d600/0xc5cf2c2a6a550590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8527 expref: 13 pid: 14297 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945686.239035:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865d1d600/0xc5cf2c2a6a550590 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8527 expref: 13 pid: 14297 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945686.239047:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945686.239055:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945686.239083:0:14291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945686.239091:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945686.239099:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945686.239330:0:14290:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87516a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0498e5a3-7601-4041-84f4-4c7941c69f16+12:2373:x1877942254810624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1227us (5088us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945686.239338:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7 00010000:00010000:0.0:1790945686.239389:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945686.239397:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0d200 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945686.239401:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945686.239409:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945686.239430:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945686.239442:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945686.239467:0:14291:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb875169500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0498e5a3-7601-4041-84f4-4c7941c69f16+11:2373:x1877942254810752:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 472us (5126us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945686.239474:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8 00010000:00010000:3.0:1790945686.239609:0:16418:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.239618:0:16418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945686.239635:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bb865f0d200/0xc5cf2c2a6a5505f2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945687.006075:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945687.639959:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945687.641586:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254810880 00000100:00100000:0.0:1790945687.641608:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254810880 00000100:00100000:0.0:1790945687.642040:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 105 00000100:00100000:0.0:1790945687.642061:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+11:13732:x1877942254810880:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790945687.642088:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945687.642114:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a5505f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c85ba expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945687.642152:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a5505f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85ba expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945687.642165:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865d1da00/0xc5cf2c2a6a5505f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85ba expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945687.642176:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1da00, rc 0) 00000100:00100000:0.0:1790945687.642258:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+12:13732:x1877942254810880:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 201us (2316us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945687.642266:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 105 00000100:00100000:0.0:1790945687.654334:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945687.654425:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254811008 00000100:00100000:3.0:1790945687.654456:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254811008 00000100:00100000:3.0:1790945687.654524:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 106 00000100:00100000:3.0:1790945687.654538:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+12:13732:x1877942254811008:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.655213:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+12:13732:x1877942254811008:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 676us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945687.655225:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 106 00000100:00100000:3.0:1790945687.663991:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945687.664036:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254811136 00000100:00100000:3.0:1790945687.664049:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254811136 00000100:00100000:3.0:1790945687.664110:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 107 00000100:00100000:3.0:1790945687.664121:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+12:13732:x1877942254811136:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.664413:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0498e5a3-7601-4041-84f4-4c7941c69f16+12:13732:x1877942254811136:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 292us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945687.664422:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 107 00000100:00100000:1.0:1790945687.684209:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945687.684478:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254811264 00000100:00100000:2.0:1790945687.684505:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254811264 00000100:00100000:2.0:1790945687.684580:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 108 00000100:00100000:2.0:1790945687.684592:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+12:13732:x1877942254811264:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790945687.684628:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945687.684652:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865431600/0xc5cf2c2a6a550600 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c85c1 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945687.684712:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865431600/0xc5cf2c2a6a550600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85c1 expref: 13 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945687.684726:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865431600/0xc5cf2c2a6a550600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85c1 expref: 13 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945687.684738:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431600, rc 0) 00000100:00100000:2.0:1790945687.684821:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13732:x1877942254811264:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 231us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945687.684829:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 108 00000100:00100000:0.0:1790945687.690428:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945687.690829:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254811392 00000100:00100000:2.0:1790945687.690844:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254811392 00000100:00100000:2.0:1790945687.690929:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 109 00000100:00100000:2.0:1790945687.690942:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13732:x1877942254811392:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790945687.691337:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13732:x1877942254811392:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 397us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945687.691356:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 109 00000100:00100000:1.0:1790945687.696441:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945687.696559:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254811520 00000100:00100000:3.0:1790945687.696574:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254811520 00000100:00100000:3.0:1790945687.696724:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 110 00000100:00100000:3.0:1790945687.696735:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13732:x1877942254811520:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.697035:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+13:13732:x1877942254811520:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 301us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945687.697044:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 110 10000000:01000000:3.0:1790945687.777366:0:14301:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790945687.777377:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb850a71800 from 10 10000000:01000000:3.0:1790945687.777384:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790945687.777449:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865f0d200/0xc5cf2c2a6a550607 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.777476:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb865f0d200/0xc5cf2c2a6a550607 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.777491:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb865f0d200/0xc5cf2c2a6a550607 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945687.777522:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.777636:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945687.777720:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790945687.777746:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273676160 00000100:00100000:3.0:1790945687.777755:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273676160 00000100:00100000:3.0:1790945687.777815:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790945687.777825:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+16:14301:x1877942273676160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945687.777842:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945687.777857:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865f0c600/0xc5cf2c2a6a55060e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a550607 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.777886:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865f0c600/0xc5cf2c2a6a55060e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550607 expref: 17 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.777897:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865f0c600/0xc5cf2c2a6a55060e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550607 expref: 17 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.777907:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865f0c600, rc 0) 00000100:00100000:3.0:1790945687.777953:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+17:14301:x1877942273676160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945687.777960:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790945687.778025:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945687.778043:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb865f0d200/0xc5cf2c2a6a550607 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55060e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.778052:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb865f0d200/0xc5cf2c2a6a550607 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a55060e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945687.778117:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.778143:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945687.778157:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d483c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945687.778170:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273676288 00000100:00100000:3.0:1790945687.778174:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273676288 00000100:00100000:3.0:1790945687.778194:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790945687.778200:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+17:14301:x1877942273676288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.778494:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+17:14301:x1877942273676288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945687.778502:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790945687.778533:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.778565:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.778624:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945687.778639:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb865d483c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945687.778652:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273676416 00000100:00100000:3.0:1790945687.778678:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273676416 00000100:00100000:3.0:1790945687.778701:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790945687.778708:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+17:14301:x1877942273676416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.778866:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+17:14301:x1877942273676416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945687.778879:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790945687.778917:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790945687.784709:0:16487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790945687.785098:0:14301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790945687.785128:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790945687.785143:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865f0d200/0xc5cf2c2a6a550607 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55060e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945687.785158:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865f0d200/0xc5cf2c2a6a550607 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55060e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790945687.785171:0:14301:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790945687.785174:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb8654d2800 from 10 10000000:01000000:1.0:1790945687.785178:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790945687.785234:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a550615 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945687.785243:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a550615 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945687.785256:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a550615 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945687.785288:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790945687.785385:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945687.785472:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb851809a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790945687.789380:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273676544 00000100:00100000:3.0:1790945687.789399:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273676544 00000100:00100000:3.0:1790945687.789473:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790945687.789486:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+17:14301:x1877942273676544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945687.789510:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945687.789534:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865f0ce00/0xc5cf2c2a6a55061c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a550615 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.789569:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865f0ce00/0xc5cf2c2a6a55061c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550615 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.789583:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865f0ce00/0xc5cf2c2a6a55061c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550615 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.789594:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865f0ce00, rc 0) 00000100:00100000:3.0:1790945687.789739:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ac65209-3704-434c-a055-442590f14168+18:14301:x1877942273676544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (4353us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945687.789746:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790945687.789819:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b37b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945687.789844:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a550615 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55061c expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.789855:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a550615 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a55061c expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945687.789955:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.789996:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945687.790031:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790945687.790046:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273676672 00000100:00100000:3.0:1790945687.790050:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273676672 00000100:00100000:3.0:1790945687.790072:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790945687.790078:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+18:14301:x1877942273676672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.790400:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+18:14301:x1877942273676672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945687.790408:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790945687.790442:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.790476:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.790518:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945687.790531:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fb1e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790945687.790543:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273676800 00000100:00100000:3.0:1790945687.790546:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273676800 00000100:00100000:3.0:1790945687.790563:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790945687.790569:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+18:14301:x1877942273676800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.790775:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+18:14301:x1877942273676800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945687.790783:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790945687.790819:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790945687.791514:0:16488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1790945687.791582:0:14301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1790945687.791600:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790945687.791623:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a550615 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55061c expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.791636:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb84167ae00/0xc5cf2c2a6a550615 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55061c expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790945687.791647:0:14301:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790945687.791650:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bb87390c000 from 10 10000000:01000000:3.0:1790945687.791654:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790945687.791705:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865f0cc00/0xc5cf2c2a6a550623 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.791714:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff9bb865f0cc00/0xc5cf2c2a6a550623 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.791724:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff9bb865f0cc00/0xc5cf2c2a6a550623 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945687.791742:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.791787:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945687.791809:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fb1e900 going to sleep for 11 seconds 00000100:00100000:3.0:1790945687.791827:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273676928 00000100:00100000:3.0:1790945687.791831:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273676928 00000100:00100000:3.0:1790945687.791861:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790945687.791870:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+18:14301:x1877942273676928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945687.791882:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945687.791895:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bb865f0d600/0xc5cf2c2a6a55062a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5cf2c2a6a550623 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.791928:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bb865f0d600/0xc5cf2c2a6a55062a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550623 expref: 19 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.791938:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bb865f0d600/0xc5cf2c2a6a55062a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc5cf2c2a6a550623 expref: 19 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.791948:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865f0d600, rc 0) 00000100:00100000:3.0:1790945687.791982:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+19:14301:x1877942273676928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945687.791989:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790945687.792029:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273676928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790945687.792043:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff9bb865f0cc00/0xc5cf2c2a6a550623 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55062a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.792053:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff9bb865f0cc00/0xc5cf2c2a6a550623 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc5cf2c2a6a55062a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945687.792095:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273677056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.792119:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945687.792132:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fb1e900 going to sleep for 11 seconds 00000100:00100000:3.0:1790945687.792144:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273677056 00000100:00100000:3.0:1790945687.792147:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273677056 00000100:00100000:3.0:1790945687.792167:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790945687.792173:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+19:14301:x1877942273677056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.792384:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+19:14301:x1877942273677056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945687.792398:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790945687.792428:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273677056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.792454:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273677184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.792493:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945687.792506:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb87fb1e900 going to sleep for 11 seconds 00000100:00100000:3.0:1790945687.792517:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273677184 00000100:00100000:3.0:1790945687.792521:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273677184 00000100:00100000:3.0:1790945687.792541:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790945687.792547:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86553c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+19:14301:x1877942273677184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790945687.803440:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86553c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ac65209-3704-434c-a055-442590f14168+19:14301:x1877942273677184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 10878us (10932us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945687.803459:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790945687.803570:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ac65209-3704-434c-a055-442590f14168:14301:1877942273677184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790945687.807621:0:16489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1790945687.808883:0:14301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1790945687.808926:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790945687.808942:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff9bb865f0cc00/0xc5cf2c2a6a550623 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55062a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945687.808958:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff9bb865f0cc00/0xc5cf2c2a6a550623 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc5cf2c2a6a55062a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945688.028043:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945688.348771:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb875168a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273677312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945688.348835:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945688.348910:0:14992:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273677312 00000100:00100000:2.0:1790945688.348918:0:14992:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273677312 00000100:00100000:2.0:1790945688.348962:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790945688.348971:0:14992:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273677312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945688.349004:0:14992:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945688.349040:0:14992:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1877942273677312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945688.349046:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1790945688.349065:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945688.349093:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb875168a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273677312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790945688.860472:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87516a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273677440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790945688.860509:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ac65209-3704-434c-a055-442590f14168:3293:1877942273677568:0@lo:400:kworker.0 00000100:00100000:3.0:1790945688.860570:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945688.860571:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945688.862235:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273677568 00000100:00100000:0.0:1790945688.862249:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273677568 00000100:00100000:0.0:1790945688.862306:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790945688.862317:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb85a03d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+19:3293:x1877942273677568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945688.862488:0:14992:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273677440 00000100:00100000:2.0:1790945688.862493:0:14992:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273677440 00000100:00100000:2.0:1790945688.862532:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790945688.862540:0:14992:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273677440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790945688.862570:0:14992:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790945688.865333:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273677952:0@lo:400:kworker.0 00000100:00100000:1.0:1790945688.865402:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945688.865429:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790945688.865435:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273678080:0@lo:400:kworker.0 00000100:00100000:1.0:1790945688.865456:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790945688.865501:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790945688.865513:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273677824:0@lo:400:kworker.0 00000100:00100000:1.0:1790945688.865536:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945688.865555:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790945688.865561:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb86c932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273677696:0@lo:400:kworker.0 00000100:00100000:1.0:1790945688.865589:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945688.865645:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273677952 00000100:00100000:1.0:1790945688.865653:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273677952 00000100:00100000:1.0:1790945688.865729:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273678080 00000100:00100000:1.0:1790945688.865733:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273678080 00000100:00100000:1.0:1790945688.865747:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273677824 00000100:00100000:1.0:1790945688.865750:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273677824 00000100:00100000:1.0:1790945688.865764:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790945688.865772:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273677952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945688.870457:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1877942273677952:12345-0@lo:400:kworker.0 Request processed in 4678us (5047us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945688.870472:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790945688.870504:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790945688.870516:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790945688.870517:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273678080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945688.870532:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273677824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790945688.870551:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1877942273678080:12345-0@lo:400:kworker.0 Request processed in 39us (5093us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945688.870567:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790945688.870618:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1877942273677824:12345-0@lo:400:kworker.0 Request processed in 89us (5079us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945688.870626:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1790945688.870639:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945688.870676:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273677696 00000100:00100000:3.0:1790945688.870684:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273677696 00000100:00100000:1.0:1790945688.870692:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1877942273678080:0@lo:400:kworker.0 00000100:00100000:1.0:1790945688.870708:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1877942273677952:0@lo:400:kworker.0 00000100:00100000:3.0:1790945688.870726:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790945688.870745:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1877942273677696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945688.870784:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1877942273677696:12345-0@lo:400:kworker.0 Request processed in 51us (5194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945688.870790:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790945688.873398:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1877942273677696:0@lo:400:kworker.0 00000100:00100000:3.0:1790945688.873415:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1877942273677824:0@lo:400:kworker.0 00000100:00100000:0.0:1790945688.875238:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb85a03d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+19:3293:x1877942273677568:12345-0@lo:400:kworker.0 Request processed in 12915us (14664us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945688.875253:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790945688.875358:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb86c931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ac65209-3704-434c-a055-442590f14168:3293:1877942273677568:0@lo:400:kworker.0 00000100:00100000:2.0:1790945688.875503:0:14992:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1877942273677440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12894us (14867us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945688.875514:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790945688.875529:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87516a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1877942273677440:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790945689.052309:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790945689.236744:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945689.236797:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945689.236819:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945689.236857:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945689.236880:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945689.236917:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945689.237081:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254812160 00000100:00100000:3.0:1790945689.237086:0:14298:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254811648 00000100:00100000:3.0:1790945689.237092:0:14298:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254811648 00000100:00100000:3.0:1790945689.237137:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 121 00000100:00100000:3.0:1790945689.237147:0:14298:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb85a03d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+13:2371:x1877942254811648:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945689.237220:0:14298:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb85a03d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0498e5a3-7601-4041-84f4-4c7941c69f16+13:2371:x1877942254811648:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 74us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945689.237227:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 121 00000100:00100000:3.0:1790945689.237275:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254811904 00000100:00100000:3.0:1790945689.237279:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254811904 00000100:00100000:2.0:1790945689.237289:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254812160 00000100:00100000:3.0:1790945689.237304:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254812416 00000100:00100000:3.0:1790945689.237316:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254812416 00000100:00100000:3.0:1790945689.237329:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254812032 00000100:00100000:2.0:1790945689.237330:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254811776 00000100:00100000:2.0:1790945689.237333:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254811776 00000100:00100000:3.0:1790945689.237344:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254812032 00000100:00100000:2.0:1790945689.237352:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 24 00000100:00100000:3.0:1790945689.237359:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:2.0:1790945689.237359:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb875168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76100aa7-c8ca-49bd-af68-2804246b11f7+6:2371:x1877942254812160:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945689.237364:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87516a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2371:x1877942254811904:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1790945689.237455:0:14990:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790945689.237465:0:14990:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1790945689.237534:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb875168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76100aa7-c8ca-49bd-af68-2804246b11f7+6:2371:x1877942254812160:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 174us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945689.237541:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 24 00000100:00100000:2.0:1790945689.237565:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 25 00000100:00100000:2.0:1790945689.237572:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87516aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:2371:x1877942254811776:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945689.239705:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87516a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2371:x1877942254811904:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 2328us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945689.239718:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:3.0:1790945689.239750:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:3.0:1790945689.239763:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87516b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+5:2371:x1877942254812416:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945689.240173:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87516b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+5:2371:x1877942254812416:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 414us (3315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945689.240180:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:3.0:1790945689.240193:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:3.0:1790945689.240200:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87516b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2371:x1877942254812032:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945689.240227:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87516b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2371:x1877942254812032:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (3309us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945689.240233:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00080000:3.0:1790945689.240640:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790945689.240646:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790945689.240649:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945689.252316:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945689.252370:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254812288 00000100:00100000:0.0:1790945689.252379:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254812288 00000100:00100000:0.0:1790945689.252434:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00080000:3.0:1790945689.252442:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790945689.252444:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb875168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+5:2371:x1877942254812288:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1790945689.252512:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb875168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+5:2371:x1877942254812288:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945689.252520:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:2.0:1790945689.259390:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87516aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:2371:x1877942254811776:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 21673us (22363us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945689.259406:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 25 00000100:00100000:0.0:1790945689.986231:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945689.986308:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254812544 00000100:00100000:3.0:1790945689.986319:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254812544 00000100:00100000:3.0:1790945689.986380:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:3.0:1790945689.986390:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb875168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:14390:x1877942254812544:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945689.986411:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945689.986459:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550631 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c85c8 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.986521:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a550638 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.986537:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a550638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.986553:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a550638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.986568:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a55063f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.986576:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a55063f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.986583:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a55063f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987286:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c400/0xc5cf2c2a6a550646 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987297:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c400/0xc5cf2c2a6a550646 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987305:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c400/0xc5cf2c2a6a550646 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945689.987332:0:14305:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790945689.987335:0:14305:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790945689.987373:0:14305:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c400/0xc5cf2c2a6a550646 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987391:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a550638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987398:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a550638 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987405:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a550638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987411:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0d800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945689.987416:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a550638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987527:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a550638 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987541:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb852834900) 00010000:00010000:3.0:1790945689.987544:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945689.987548:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a550638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987554:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a550638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987567:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a55063f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987573:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a55063f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987578:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a55063f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987603:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0da00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945689.987606:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a55063f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987612:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a55063f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987619:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bb851c9aa00) 00010000:00010000:3.0:1790945689.987621:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945689.987623:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a55063f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987629:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a55063f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987708:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550631 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85c8 expref: 8 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987723:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c400/0xc5cf2c2a6a550646 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85c8 expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.987730:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bb851c9a400) 00010000:00010000:3.0:1790945689.987733:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945689.987735:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865f0c400, rc 0) 00000100:00100000:3.0:1790945689.988094:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb875168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:14390:x1877942254812544:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 1703us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945689.988103:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:1.0:1790945689.996887:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945689.997021:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254812800 00000100:00100000:3.0:1790945689.997045:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254812800 00000100:00100000:3.0:1790945689.997108:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:3.0:1790945689.997117:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:14390:x1877942254812800:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945689.997141:0:15011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945689.997162:0:15011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a55064d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c85cf expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.997238:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a550654 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.997252:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a550654 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.997263:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a550654 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.997278:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55065b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.997284:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55065b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.997289:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55065b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.997629:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c000/0xc5cf2c2a6a550662 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.997639:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c000/0xc5cf2c2a6a550662 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.997645:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c000/0xc5cf2c2a6a550662 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945689.997688:0:15011:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790945689.997893:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a550654 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.997901:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a550654 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.997908:0:15011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a550654 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.997914:0:15011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0da00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945689.998236:0:15011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a550654 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.998246:0:15011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a550654 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.998260:0:15011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bb851c9a400) 00010000:00010000:3.0:1790945689.998263:0:15011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945689.998268:0:15011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a550654 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.998274:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a550654 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.998288:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55065b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.998293:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55065b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.998311:0:15011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55065b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.998316:0:15011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0d800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945689.998319:0:15011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55065b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.998324:0:15011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55065b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.998332:0:15011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bb851c9aa00) 00010000:00010000:3.0:1790945689.998334:0:15011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945689.998337:0:15011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55065b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.998342:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55065b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.999277:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a55064d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85cf expref: 10 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.999298:0:15011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c000/0xc5cf2c2a6a550662 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85cf expref: 9 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945689.999306:0:15011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a200) 00010000:00010000:3.0:1790945689.999309:0:15011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945689.999312:0:15011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865f0c000, rc 0) 00000100:00100000:3.0:1790945689.999472:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:14390:x1877942254812800:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 2354us (2592us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790945689.999493:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:1.0:1790945690.013914:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945690.013972:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254812928 00000100:00100000:0.0:1790945690.013983:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254812928 00000100:00100000:0.0:1790945690.014053:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 17 00000100:00100000:0.0:1790945690.014063:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:14390:x1877942254812928:12345-192.168.202.48@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790945690.014178:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:14390:x1877942254812928:12345-192.168.202.48@tcp:59:lhsmtool_posix.0 Request processed in 115us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945690.014185:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 17 00010000:00010000:0.0:1790945690.079328:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790945690.100206:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945690.100381:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254813056 00000100:00100000:2.0:1790945690.100391:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254813056 00000100:00100000:2.0:1790945690.100453:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 18 00000100:00100000:2.0:1790945690.100463:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:14396:x1877942254813056:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945690.100486:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945690.100511:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550670 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c85d6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.100585:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a550677 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.100639:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a550677 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.100654:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a550677 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.100852:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a55067e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.100862:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a55067e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.100871:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a55067e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101091:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a550677 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101100:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a550677 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101108:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a550677 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101115:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865430e00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945690.101120:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a550677 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101128:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a550677 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101142:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb852834900) 00010000:00010000:2.0:1790945690.101145:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945690.101150:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a550677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101157:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a550677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101169:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a55067e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101176:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a55067e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101183:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a55067e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101194:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865430200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945690.101197:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a55067e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101203:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a55067e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101212:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bb845042400) 00010000:00010000:2.0:1790945690.101214:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945690.101218:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a55067e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.101224:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a55067e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.102349:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550670 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85d6 expref: 10 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.102363:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb852834900) 00010000:00010000:2.0:1790945690.102366:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945690.102371:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550670 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85d6 expref: 10 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.102382:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431000, rc 0) 00000100:00100000:2.0:1790945690.102452:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:14396:x1877942254813056:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1989us (2257us total) trans 0 rc 301/301 00000100:00100000:2.0:1790945690.102463:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 18 00000100:00100000:2.0:1790945690.118329:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945690.118545:0:14313:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254813184 00000100:00100000:3.0:1790945690.118564:0:14313:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254813184 00000100:00100000:3.0:1790945690.118697:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:3.0:1790945690.118711:0:14313:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:14396:x1877942254813184:12345-192.168.202.48@tcp:700:lfs.0 00000100:00100000:3.0:1790945690.123653:0:14313:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:14396:x1877942254813184:12345-192.168.202.48@tcp:700:lfs.0 Request processed in 4927us (5316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945690.123689:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:1.0:1790945690.126956:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945690.127729:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254813440 00000100:00100000:0.0:1790945690.127746:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254813440 00000100:00100000:0.0:1790945690.127827:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 19 00000100:00100000:0.0:1790945690.127837:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:14396:x1877942254813440:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:0.0:1790945690.127918:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945690.127948:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167ba00/0xc5cf2c2a6a5505b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8551 expref: 9 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.127969:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb852834900) 00010000:00010000:0.0:1790945690.127974:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945690.128179:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.128194:0:14304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5505eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85b3 expref: 5 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.128203:0:14304:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.128332:0:14304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5505eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85b3 expref: 5 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.128348:0:14304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5505eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85b3 expref: 5 pid: 15011 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945690.128363:0:14304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb875168a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1877942273678208:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945690.129729:0:14304:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb843442540 going to sleep for 11 seconds 00000100:00100000:1.0:1790945690.148476:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945690.148599:0:14304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb875168a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1877942273678208:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945690.148627:0:14304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945690.148763:0:14290:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254813568 00000100:00100000:3.0:1790945690.148779:0:14290:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254813568 00010000:00010000:3.0:1790945690.148822:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5505eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85b3 expref: 6 pid: 15011 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945690.148860:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:3.0:1790945690.148869:0:14290:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b379f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+6:2373:x1877942254813568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945690.148890:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945690.148896:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5505eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85b3 expref: 6 pid: 15011 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.148908:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5505eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85b3 expref: 6 pid: 15011 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.148931:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5505eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85b3 expref: 6 pid: 15011 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.148946:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb852834900) 00010000:00010000:3.0:1790945690.148963:0:14290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.148973:0:14290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.148981:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.149019:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945690.149083:0:14290:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b379f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+5:2373:x1877942254813568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 214us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945690.149091:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9 00010000:00010000:1.0:1790945690.149684:0:14304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.149705:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.149737:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55068c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.149748:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55068c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.149757:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55068c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945690.151279:0:14304:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790945690.151295:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.151315:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.151321:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.151327:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945690.151332:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.151340:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.151353:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb852834900) 00010000:00010000:1.0:1790945690.151356:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945690.151361:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.151366:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550685 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790945690.151388:0:14304:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007cf6b0f0 reply state 0000000039b94600 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55068c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945690.151396:0:14304:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790945690.151497:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+10:14396:x1877942254813440:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 23658us (24552us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790945690.151507:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 19 00010000:00010000:2.0:1790945690.161349:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55068c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.161367:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55068c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.161376:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55068c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.161382:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167aa00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945690.161386:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55068c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.161395:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55068c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.161413:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bb852834600) 00010000:00010000:2.0:1790945690.161416:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945690.161422:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55068c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.161428:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55068c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945690.333332:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945690.333419:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254813696 00000100:00100000:3.0:1790945690.333428:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254813696 00000100:00100000:3.0:1790945690.333483:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 20 00000100:00100000:3.0:1790945690.333492:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:14405:x1877942254813696:12345-192.168.202.48@tcp:101:lctl.0 00010000:00010000:3.0:1790945690.333515:0:15011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945690.333538:0:15011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c85dd expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.333612:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55069a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.333626:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55069a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.333643:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55069a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945690.333702:0:15011:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790945690.333719:0:15011:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790945690.333759:0:15011:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55069a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.333796:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85dd expref: 11 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.333887:0:15011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d800/0xc5cf2c2a6a55069a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85dd expref: 10 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.333898:0:15011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb851c9aa00) 00010000:00010000:3.0:1790945690.333901:0:15011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945690.333904:0:15011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865f0d800, rc 0) 00000100:00100000:3.0:1790945690.334066:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+10:14405:x1877942254813696:12345-192.168.202.48@tcp:101:lctl.0 Request processed in 574us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945690.334074:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 20 00000100:00100000:1.0:1790945690.360937:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945690.361007:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254813824 00000100:00100000:3.0:1790945690.361017:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254813824 00000100:00100000:3.0:1790945690.361061:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 21 00000100:00100000:3.0:1790945690.361068:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+5:14406:x1877942254813824:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945690.361086:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945690.361103:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a5506a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c85e4 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.361156:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a5506a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.361168:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a5506a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.361192:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a5506a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945690.361221:0:14305:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790945690.361223:0:14305:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790945690.361251:0:14305:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a5506a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.361271:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a5506a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85e4 expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.361285:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0da00/0xc5cf2c2a6a5506a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85e4 expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.361291:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb851c9aa00) 00010000:00010000:3.0:1790945690.361293:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790945690.361295:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865f0da00, rc 0) 00000100:00100000:3.0:1790945690.361349:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+6:14406:x1877942254813824:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 281us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945690.361353:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 21 00000100:00100000:0.0:1790945690.367246:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945690.367370:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254813952 00000100:00100000:2.0:1790945690.367381:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254813952 00000100:00100000:2.0:1790945690.367449:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 22 00000100:00100000:2.0:1790945690.367460:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb875168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76100aa7-c8ca-49bd-af68-2804246b11f7+6:14406:x1877942254813952:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945690.367481:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945690.367502:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5506af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c85eb expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.367598:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a5506b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.367613:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a5506b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.367625:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a5506b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.367639:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5506bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.367646:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5506bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.367653:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5506bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368030:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a5506c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368039:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a5506c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368047:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a5506c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945690.368078:0:14306:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790945690.368082:0:14306:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945690.368101:0:14306:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a5506c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368122:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a5506b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368129:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a5506b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368136:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a5506b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368141:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865431800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945690.368145:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a5506b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368153:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a5506b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368164:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb851c9aa00) 00010000:00010000:2.0:1790945690.368167:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945690.368172:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a5506b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368178:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a5506b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368191:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5506bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368196:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5506bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368201:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5506bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368212:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865430600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:2.0:1790945690.368214:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5506bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368220:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5506bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368228:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bb845042400) 00010000:00010000:2.0:1790945690.368230:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790945690.368233:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5506bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368238:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5506bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368268:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5506af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85eb expref: 8 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368280:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a5506c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85eb expref: 7 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.368286:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb845042a00) 00010000:00010000:2.0:1790945690.368289:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945690.368291:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865430e00, rc 0) 00000100:00100000:2.0:1790945690.368362:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb875168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76100aa7-c8ca-49bd-af68-2804246b11f7+7:14406:x1877942254813952:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 904us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945690.368371:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 22 00000100:00100000:2.0:1790945690.375441:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945690.375543:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254814208 00000100:00100000:3.0:1790945690.375555:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254814208 00000100:00100000:3.0:1790945690.375957:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 23 00000100:00100000:3.0:1790945690.375969:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+7:14406:x1877942254814208:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945690.375991:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945690.376012:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a5506cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c85f2 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945690.376114:0:14305:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790945690.376250:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a5506cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85f2 expref: 9 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.376263:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb851c9aa00) 00010000:00010000:3.0:1790945690.376266:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945690.376271:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a5506cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85f2 expref: 9 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.376285:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865f0c200, rc 0) 00000100:00100000:3.0:1790945690.376357:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+8:14406:x1877942254814208:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 391us (924us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1790945690.376365:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 23 00000100:00100000:1.0:1790945690.387634:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945690.387894:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254814464 00000100:00100000:2.0:1790945690.387904:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254814464 00000100:00100000:2.0:1790945690.387962:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 24 00000100:00100000:2.0:1790945690.387971:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76100aa7-c8ca-49bd-af68-2804246b11f7+8:14406:x1877942254814464:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:2.0:1790945690.388026:0:14306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945690.388052:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a5506c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85eb expref: 8 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.388069:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb845042a00) 00010000:00010000:2.0:1790945690.388079:0:14306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945690.388101:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5506d9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.388113:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5506d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.388122:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5506d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945690.388335:0:14306:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002fe1f230 reply state 00000000b84dd356 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5506d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945690.388345:0:14306:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790945690.388353:0:14306:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790945690.388436:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76100aa7-c8ca-49bd-af68-2804246b11f7+9:14406:x1877942254814464:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 465us (812us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1790945690.388444:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 24 00000100:00100000:2.0:1790945690.392876:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1790945690.394013:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5506d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.394027:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5506d9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.394035:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5506d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.394041:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865431200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945690.394046:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5506d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.394054:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5506d9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.394070:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb845042400) 00010000:00010000:1.0:1790945690.394073:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790945690.394077:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5506d9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.394084:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5506d9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945690.394120:0:14308:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254814720 00000100:00100000:1.0:1790945690.394128:0:14308:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254814720 00000100:00100000:1.0:1790945690.394179:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:1.0:1790945690.394188:0:14308:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+8:14406:x1877942254814720:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:1.0:1790945690.394473:0:14308:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+9:14406:x1877942254814720:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 284us (1605us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790945690.394480:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2 00000040:00080000:1.0:1790945690.404274:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790945690.407652:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945690.408377:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254814976 00000100:00100000:1.0:1790945690.408389:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254814976 00000100:00100000:1.0:1790945690.408450:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 25 00000100:00100000:1.0:1790945690.408461:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+9:14406:x1877942254814976:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1790945690.408487:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945690.408508:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5506e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c85f9 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.408581:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a5506e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.408605:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a5506e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.408616:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a5506e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.408631:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a5506ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.408639:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a5506ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.408645:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a5506ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945690.408949:0:14304:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790945690.409028:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a5506e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409035:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a5506e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409053:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a5506e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409059:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167be00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945690.409064:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a5506e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409071:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a5506e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409083:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb851c9aa00) 00010000:00010000:1.0:1790945690.409086:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945690.409090:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a5506e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409098:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a5506e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409109:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a5506ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409115:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a5506ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409120:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a5506ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409125:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167a400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945690.409128:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a5506ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409142:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a5506ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409149:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bb852834900) 00010000:00010000:1.0:1790945690.409151:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945690.409153:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a5506ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409158:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a5506ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409193:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5506e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85f9 expref: 11 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409202:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb851c9aa00) 00010000:00010000:1.0:1790945690.409204:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790945690.409207:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5506e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c85f9 expref: 11 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.409215:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167b400, rc 0) 00000100:00100000:1.0:1790945690.412247:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+10:14406:x1877942254814976:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3768us (4584us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1790945690.412261:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 25 00000100:00100000:3.0:1790945690.415505:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945690.416005:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254815104 00000100:00100000:2.0:1790945690.416030:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254815104 00000100:00100000:2.0:1790945690.416092:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 26 00000100:00100000:2.0:1790945690.416103:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76100aa7-c8ca-49bd-af68-2804246b11f7+10:14406:x1877942254815104:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1790945690.416129:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945690.416153:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5506fc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8600 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.416257:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a550703 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.416271:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a550703 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.416284:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a550703 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945690.416309:0:14306:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790945690.416312:0:14306:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945690.416330:0:14306:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a550703 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.416353:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430600/0xc5cf2c2a6a5506fc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8600 expref: 12 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.416369:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a550703 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8600 expref: 11 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945690.416378:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb845042a00) 00010000:00010000:2.0:1790945690.416381:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790945690.416383:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431800, rc 0) 00000100:00100000:2.0:1790945690.416454:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76100aa7-c8ca-49bd-af68-2804246b11f7+11:14406:x1877942254815104:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 352us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945690.416461:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 26 00000100:00100000:2.0:1790945690.421286:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945690.426511:0:14308:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254815232 00000100:00100000:1.0:1790945690.426528:0:14308:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254815232 00000100:00100000:1.0:1790945690.426603:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3 00000100:00100000:1.0:1790945690.426615:0:14308:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+11:14406:x1877942254815232:12345-192.168.202.48@tcp:37:lfs.0 00000100:00100000:1.0:1790945690.437225:0:14308:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+11:14406:x1877942254815232:12345-192.168.202.48@tcp:37:lfs.0 Request processed in 10602us (15938us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945690.437240:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3 00000100:00100000:2.0:1790945690.443258:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945690.443469:0:14307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254815488 00000100:00100000:0.0:1790945690.443480:0:14307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254815488 00000100:00100000:0.0:1790945690.443545:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:0.0:1790945690.443556:0:14307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+11:14406:x1877942254815488:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1790945690.444000:0:14307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+12:14406:x1877942254815488:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 444us (750us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790945690.444009:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:2.0:1790945690.527709:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945690.528023:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254815616 00000100:00100000:3.0:1790945690.528036:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254815616 00000100:00100000:3.0:1790945690.528102:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 27 00000100:00100000:3.0:1790945690.528113:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+10:14412:x1877942254815616:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:3.0:1790945690.528134:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945690.528154:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a55070a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8607 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528217:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550711 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528231:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550711 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528256:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550711 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528271:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d000/0xc5cf2c2a6a550718 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528278:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d000/0xc5cf2c2a6a550718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528285:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d000/0xc5cf2c2a6a550718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528388:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0ca00/0xc5cf2c2a6a55071f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528398:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0ca00/0xc5cf2c2a6a55071f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528405:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0ca00/0xc5cf2c2a6a55071f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945690.528445:0:14305:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790945690.528448:0:14305:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790945690.528491:0:14305:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0ca00/0xc5cf2c2a6a55071f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528504:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550711 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528511:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550711 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528528:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550711 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528534:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0c200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945690.528539:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550711 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528547:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550711 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528559:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb851c9aa00) 00010000:00010000:3.0:1790945690.528562:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945690.528567:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528574:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a550711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528598:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d000/0xc5cf2c2a6a550718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528604:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d000/0xc5cf2c2a6a550718 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528610:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d000/0xc5cf2c2a6a550718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528615:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0d000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:3.0:1790945690.528618:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d000/0xc5cf2c2a6a550718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528635:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d000/0xc5cf2c2a6a550718 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528643:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bb851c9a500) 00010000:00010000:3.0:1790945690.528646:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790945690.528649:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d000/0xc5cf2c2a6a550718 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.528703:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d000/0xc5cf2c2a6a550718 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.529256:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a55070a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8607 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.529275:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0ca00/0xc5cf2c2a6a55071f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8607 expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.529283:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb845042a00) 00010000:00010000:3.0:1790945690.529285:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790945690.529287:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865f0ca00, rc 0) 00000100:00100000:3.0:1790945690.529360:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+11:14412:x1877942254815616:12345-192.168.202.48@tcp:101:bash.0 Request processed in 1249us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945690.529369:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 27 00000100:00100000:2.0:1790945690.540481:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945690.540695:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254815872 00000100:00100000:1.0:1790945690.540706:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254815872 00000100:00100000:1.0:1790945690.540778:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 28 00000100:00100000:1.0:1790945690.540788:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+11:14412:x1877942254815872:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:1.0:1790945690.540811:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945690.540839:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550726 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c860e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.540953:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.540969:0:14306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a550703 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8600 expref: 11 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.540978:0:14306:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.541011:0:14306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a550703 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8600 expref: 11 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.541026:0:14306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a550703 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8600 expref: 11 pid: 14306 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945690.541040:0:14306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14306:1877942273678336:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945690.541146:0:14306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb851809e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790945690.545710:0:14306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14306:1877942273678336:192.168.202.48@tcp:104: 00010000:00010000:1.0:1790945690.545911:0:14306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945690.548023:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945690.548355:0:16420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254816000 00000100:00100000:0.0:1790945690.548366:0:16420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254816000 00010000:00010000:0.0:1790945690.548408:0:16420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a550703 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8600 expref: 12 pid: 14306 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945690.548455:0:16420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:0.0:1790945690.548465:0:16420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76100aa7-c8ca-49bd-af68-2804246b11f7+12:2372:x1877942254816000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945690.548482:0:16420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945690.548488:0:16420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a550703 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8600 expref: 12 pid: 14306 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.548500:0:16420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a550703 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8600 expref: 12 pid: 14306 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.548521:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431800/0xc5cf2c2a6a550703 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8600 expref: 12 pid: 14306 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.548537:0:16420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb845042a00) 00010000:00010000:0.0:1790945690.548542:0:16420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.548569:0:16420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.548576:0:16420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.548618:0:16420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945690.549003:0:16420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76100aa7-c8ca-49bd-af68-2804246b11f7+11:2372:x1877942254816000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 538us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945690.549011:0:16420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10 00010000:00010000:1.0:1790945690.549457:0:14306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.549467:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.549492:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550734 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.549502:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550734 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.549511:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550734 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.551123:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b600/0xc5cf2c2a6a55073b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.551141:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b600/0xc5cf2c2a6a55073b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.551151:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b600/0xc5cf2c2a6a55073b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945690.551162:0:14306:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790945690.551189:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.551209:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.551216:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.551222:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167a400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945690.551227:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.551235:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.551246:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb845042a00) 00010000:00010000:1.0:1790945690.551249:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945690.551254:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.551260:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55072d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790945690.551274:0:14306:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000530cffd5 reply state 00000000591fb57a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550734 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945690.551282:0:14306:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790945690.552010:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550726 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c860e expref: 14 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.552031:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b600/0xc5cf2c2a6a55073b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c860e expref: 13 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.552054:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:1.0:1790945690.552057:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1790945690.552060:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167b600, rc 0) 00000100:00100000:1.0:1790945690.552199:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+14:14412:x1877942254815872:12345-192.168.202.48@tcp:101:bash.0 Request processed in 11410us (11726us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790945690.552209:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 28 00010000:00010000:1.0:1790945690.563922:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550734 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.563943:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550734 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.563952:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550734 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.563958:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167be00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945690.563963:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550734 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.563971:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550734 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.563988:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bb852834900) 00010000:00010000:1.0:1790945690.563991:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945690.563996:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550734 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.564002:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550734 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945690.570397:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945690.571827:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254816128 00000100:00100000:1.0:1790945690.571840:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254816128 00000100:00100000:1.0:1790945690.571911:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 29 00000100:00100000:1.0:1790945690.571932:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb86c932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+13:14412:x1877942254816128:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:1.0:1790945690.571958:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945690.571979:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550749 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8615 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.572051:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550750 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.572068:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550750 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.572080:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550750 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945690.572122:0:14304:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790945690.572127:0:14304:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790945690.572146:0:14304:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550750 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.572156:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550750 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.572179:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550749 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8615 expref: 15 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.572196:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550750 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8615 expref: 14 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.572219:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:1.0:1790945690.572222:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945690.572226:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167b400, rc 0) 00000100:00100000:1.0:1790945690.572301:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb86c932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+14:14412:x1877942254816128:12345-192.168.202.48@tcp:101:bash.0 Request processed in 380us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945690.572317:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 29 00000100:00100000:2.0:1790945690.576052:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945690.576244:0:14308:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254816384 00000100:00100000:1.0:1790945690.576256:0:14308:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254816384 00000100:00100000:1.0:1790945690.576324:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:1.0:1790945690.576334:0:14308:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+14:14412:x1877942254816384:12345-192.168.202.48@tcp:35:bash.0 00000100:00100000:1.0:1790945690.577005:0:14308:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+15:14412:x1877942254816384:12345-192.168.202.48@tcp:35:bash.0 Request processed in 669us (959us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1790945690.577015:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:2.0:1790945690.707017:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945690.707128:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254816640 00000100:00100000:3.0:1790945690.707140:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254816640 00000100:00100000:3.0:1790945690.707209:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 30 00000100:00100000:3.0:1790945690.707219:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+15:14422:x1877942254816640:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1790945690.707262:0:15011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945690.707285:0:15011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a550757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c861c expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790945690.707384:0:15011:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790945690.707511:0:15011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a550757 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c861c expref: 17 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.707531:0:15011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bb851c9aa00) 00010000:00010000:3.0:1790945690.707535:0:15011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790945690.707541:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a550757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c861c expref: 17 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.707557:0:15011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865f0c800, rc 0) 00000100:00100000:3.0:1790945690.707645:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+16:14422:x1877942254816640:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 426us (637us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1790945690.707652:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 30 00000100:00100000:2.0:1790945690.723006:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945690.723116:0:14308:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254816896 00000100:00100000:1.0:1790945690.723129:0:14308:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254816896 00000100:00100000:1.0:1790945690.723186:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:1.0:1790945690.723197:0:14308:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+16:14422:x1877942254816896:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:1.0:1790945690.723885:0:14308:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+17:14422:x1877942254816896:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 688us (889us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1790945690.723895:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:2.0:1790945690.805330:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945690.806569:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254817152 00000100:00100000:1.0:1790945690.806624:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254817152 00000100:00100000:1.0:1790945690.806725:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 31 00000100:00100000:1.0:1790945690.806737:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+17:14425:x1877942254817152:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1790945690.806781:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945690.806804:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550765 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8623 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.806908:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55076c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.806924:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55076c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.806938:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55076c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945690.806950:0:14304:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790945690.807083:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550765 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8623 expref: 20 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.807102:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55076c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8623 expref: 19 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945690.807111:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:1.0:1790945690.807114:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945690.807117:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167a400, rc 0) 00000100:00100000:1.0:1790945690.807195:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+19:14425:x1877942254817152:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 460us (1875us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1790945690.807203:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 31 00000100:00100000:2.0:1790945690.810615:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945690.810706:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945690.810785:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254817280 00000100:00100000:0.0:1790945690.810797:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254817280 00000100:00100000:0.0:1790945690.810851:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 32 00000100:00100000:0.0:1790945690.810862:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+19:14425:x1877942254817280:12345-192.168.202.48@tcp:54:lfs.0 00010000:00010000:0.0:1790945690.810945:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ce00/0xc5cf2c2a6a55077a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.810961:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ce00/0xc5cf2c2a6a55077a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.810974:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ce00/0xc5cf2c2a6a55077a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.811004:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ce00/0xc5cf2c2a6a55077a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.811012:0:15011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ce00/0xc5cf2c2a6a55077a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.811038:0:15011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ce00/0xc5cf2c2a6a55077a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.811044:0:15011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1ce00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945690.811050:0:15011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ce00/0xc5cf2c2a6a55077a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.811058:0:15011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ce00/0xc5cf2c2a6a55077a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.811070:0:15011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:0.0:1790945690.811073:0:15011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945690.811079:0:15011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ce00/0xc5cf2c2a6a55077a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945690.811086:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ce00/0xc5cf2c2a6a55077a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945690.811175:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+19:14425:x1877942254817280:12345-192.168.202.48@tcp:54:lfs.0 Request processed in 314us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945690.811182:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 32 00000100:00100000:3.0:1790945690.811307:0:14290:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254817408 00000100:00100000:3.0:1790945690.811312:0:14290:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254817408 00000100:00100000:3.0:1790945690.811356:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:3.0:1790945690.811364:0:14290:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+19:2371:x1877942254817408:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945690.811379:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945690.811396:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a400/0xc5cf2c2a6a55076c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8623 expref: 19 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945690.811409:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:3.0:1790945690.811412:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945690.811453:0:14290:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+18:2371:x1877942254817408:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 90us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945690.811460:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:2.0:1790945690.816476:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945690.817563:0:14307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254817664 00000100:00100000:0.0:1790945690.817577:0:14307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254817664 00000100:00100000:0.0:1790945690.817672:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:0.0:1790945690.817682:0:14307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+18:14425:x1877942254817664:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1790945690.817922:0:14307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+19:14425:x1877942254817664:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 241us (1454us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1790945690.817930:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7 00010000:00010000:0.0:1790945691.099888:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945691.137631:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945691.137827:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254817920 00000100:00100000:1.0:1790945691.137838:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254817920 00000100:00080000:3.0:1790945691.137916:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790945691.137930:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00100000:1.0:1790945691.137956:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+19:14456:x1877942254817920:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1790945691.137981:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945691.138001:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550781 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c862a expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.138100:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a550788 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.138116:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a550788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.138129:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a550788 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945691.138141:0:14304:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790945691.138289:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167be00/0xc5cf2c2a6a550781 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c862a expref: 22 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.138308:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a550788 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c862a expref: 21 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.138318:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:1.0:1790945691.138321:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790945691.138325:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167aa00, rc 0) 00000100:00100000:1.0:1790945691.138402:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+21:14456:x1877942254817920:12345-192.168.202.48@tcp:101:cat.0 Request processed in 451us (787us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1790945691.138417:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00100000:2.0:1790945691.143011:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945691.143291:0:16420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254818048 00000100:00100000:3.0:1790945691.143302:0:16420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254818048 00000100:00100000:3.0:1790945691.143381:0:16420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:3.0:1790945691.143392:0:16420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+21:2373:x1877942254818048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945691.143409:0:16420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945691.143597:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a550788 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c862a expref: 21 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.143617:0:16420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:3.0:1790945691.143623:0:16420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790945691.143709:0:16420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+20:2373:x1877942254818048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 318us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945691.143716:0:16420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:2.0:1790945691.146368:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.147121:0:14307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254818304 00000100:00100000:0.0:1790945691.147133:0:14307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254818304 00000100:00100000:0.0:1790945691.147497:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:0.0:1790945691.147508:0:14307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+20:14456:x1877942254818304:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1790945691.148011:0:14307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+21:14456:x1877942254818304:12345-192.168.202.48@tcp:35:cat.0 Request processed in 504us (1650us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1790945691.148020:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:2.0:1790945691.226745:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.226862:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254818560 00000100:00100000:0.0:1790945691.226873:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254818560 00000100:00100000:0.0:1790945691.226988:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 34 00000100:00100000:0.0:1790945691.227010:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+21:14462:x1877942254818560:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1790945691.227036:0:15011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945691.227057:0:15011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ce00/0xc5cf2c2a6a550796 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8631 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.227160:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a55079d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.227185:0:15011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b600/0xc5cf2c2a6a55073b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c860e expref: 22 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.227194:0:15011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550750 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8615 expref: 22 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.227202:0:15011:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a55079d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.227254:0:15011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550750 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8615 expref: 22 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.227268:0:15011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550750 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8615 expref: 22 pid: 14304 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945691.227281:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b375c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15011:1877942273678464:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945691.227399:0:15011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b600/0xc5cf2c2a6a55073b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c860e expref: 22 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.227408:0:15011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b600/0xc5cf2c2a6a55073b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c860e expref: 22 pid: 14306 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945691.227417:0:15011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b374700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15011:1877942273678592:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945691.227441:0:15011:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb851facc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945691.239717:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b375c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15011:1877942273678464:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945691.239734:0:15011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b374700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15011:1877942273678592:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945691.239765:0:15011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a55079d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945691.252462:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945691.252509:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.252631:0:14291:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254818688 00000100:00100000:0.0:1790945691.252642:0:14291:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254818688 00010000:00010000:0.0:1790945691.254519:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b600/0xc5cf2c2a6a55073b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c860e expref: 23 pid: 14306 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945691.254629:0:14291:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254818816 00000100:00100000:0.0:1790945691.254650:0:14291:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254818816 00010000:00010000:0.0:1790945691.254689:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550750 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8615 expref: 24 pid: 14304 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945691.254750:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:2.0:1790945691.254771:0:14289:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87392fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+24:2372:x1877942254818688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945691.254788:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945691.254795:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b600/0xc5cf2c2a6a55073b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c860e expref: 24 pid: 14306 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.254818:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b600/0xc5cf2c2a6a55073b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c860e expref: 24 pid: 14306 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.254841:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b600/0xc5cf2c2a6a55073b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c860e expref: 24 pid: 14306 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.254856:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:2.0:1790945691.254861:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a55079d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.254868:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a55079d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.254874:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945691.254936:0:14289:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87392fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+23:2372:x1877942254818688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 168us (2484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945691.254943:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:2.0:1790945691.254988:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:2.0:1790945691.255141:0:14289:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+22:2371:x1877942254818816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945691.255150:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945691.255155:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550750 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8615 expref: 22 pid: 14304 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.255166:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550750 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8615 expref: 22 pid: 14304 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.255763:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550750 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8615 expref: 22 pid: 14304 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.255777:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:2.0:1790945691.255781:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a55079d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.255789:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a55079d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.255797:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a55079d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.255822:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945691.255850:0:14289:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+21:2371:x1877942254818816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 856us (3341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945691.255857:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12 00010000:00010000:1.0:1790945691.256258:0:15011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a55079d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.256275:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a55079d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945691.256294:0:15011:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790945691.256461:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ce00/0xc5cf2c2a6a550796 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8631 expref: 22 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.256479:0:15011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1ca00/0xc5cf2c2a6a55079d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8631 expref: 21 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.256486:0:15011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:1.0:1790945691.256489:0:15011:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790945691.256492:0:15011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1ca00, rc 0) 00000100:00100000:1.0:1790945691.256536:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+21:14462:x1877942254818560:12345-192.168.202.48@tcp:101:dd.0 Request processed in 29530us (29801us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1790945691.256543:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 34 00000100:00100000:1.0:1790945691.262284:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945691.263624:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254819072 00000100:00100000:3.0:1790945691.263637:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254819072 00000100:00100000:3.0:1790945691.263732:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 35 00000100:00100000:3.0:1790945691.263743:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+21:14462:x1877942254819072:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:3.0:1790945691.264012:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a5507ab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.264028:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a5507ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.264038:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a5507ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945691.264106:0:14304:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1790945691.264134:0:14304:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008eb5fc2d reply state 00000000f1edc1c8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a5507ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945691.264143:0:14304:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790945691.264248:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+24:14462:x1877942254819072:12345-192.168.202.48@tcp:36:dd.0 Request processed in 506us (1974us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1790945691.264255:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 35 00000020:00080000:3.0:1790945691.264260:0:14304:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790945691.267285:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a5507ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.267304:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a5507ab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.267320:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a5507ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.267327:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0c800 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945691.267332:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a5507ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.267358:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a5507ab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.267377:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:1.0:1790945691.267381:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945691.267386:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a5507ab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.267392:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c800/0xc5cf2c2a6a5507ab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945691.270901:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945691.271184:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254819200 00000100:00100000:2.0:1790945691.271195:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254819200 00000100:00100000:2.0:1790945691.271259:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00100000:2.0:1790945691.271270:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+23:14462:x1877942254819200:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1790945691.271298:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945691.271329:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5507b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8638 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.271399:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5507b2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8638 expref: 24 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.271435:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5507b2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8638 expref: 24 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.271458:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:2.0:1790945691.271461:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945691.271465:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431200, rc 0) 00000100:00100000:2.0:1790945691.271530:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+24:14462:x1877942254819200:12345-192.168.202.48@tcp:101:dd.0 Request processed in 262us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945691.271537:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00100000:2.0:1790945691.296380:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.296592:0:14289:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254819456 00000100:00100000:0.0:1790945691.296603:0:14289:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254819456 00000100:00100000:0.0:1790945691.296750:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:0.0:1790945691.296769:0:14289:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+24:14462:x1877942254819456:12345-192.168.202.48@tcp:103:dd.0 00010000:00010000:0.0:1790945691.296787:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945691.296822:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a5507b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8638 expref: 24 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.296844:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:0.0:1790945691.296850:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790945691.298407:0:14289:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+23:14462:x1877942254819456:12345-192.168.202.48@tcp:103:dd.0 Request processed in 1632us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945691.298425:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:3.0:1790945691.302987:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.303061:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254819584 00000100:00100000:0.0:1790945691.303072:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254819584 00000100:00100000:0.0:1790945691.303125:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 37 00000100:00100000:0.0:1790945691.303134:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+23:14462:x1877942254819584:12345-192.168.202.48@tcp:58:dd.0 00010000:00010000:0.0:1790945691.303238:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a5507b9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.303254:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a5507b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.303264:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a5507b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790945691.304204:0:14305:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790945691.304363:0:14305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1790945691.304452:0:14305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1790945691.304572:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+23:14462:x1877942254819584:12345-192.168.202.48@tcp:58:dd.0 Request processed in 1435us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945691.304594:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 37 00000100:00100000:2.0:1790945691.318423:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945691.318505:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254819712 00000100:00100000:1.0:1790945691.318517:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254819712 00000100:00100000:1.0:1790945691.318599:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 38 00000100:00100000:1.0:1790945691.318611:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+23:14462:x1877942254819712:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1790945691.318633:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945691.318654:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a000/0xc5cf2c2a6a5507c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c863f expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.318747:0:14306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a5507b9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.318770:0:14306:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a000/0xc5cf2c2a6a5507c0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c863f expref: 24 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.318807:0:14306:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a5507b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.318834:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a000/0xc5cf2c2a6a5507c0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c863f expref: 24 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.318849:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:1.0:1790945691.318852:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790945691.318856:0:14306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a000/0xc5cf2c2a6a5507c0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c863f expref: 24 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.318864:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167a000, rc 0) 00000100:00100000:1.0:1790945691.318927:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+24:14462:x1877942254819712:12345-192.168.202.48@tcp:101:dd.0 Request processed in 319us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945691.318935:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 38 00000040:00080000:0.0:1790945691.420489:0:14339:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790945691.420499:0:14339:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790945691.420565:0:14339:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790945691.420571:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790945691.420746:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b374700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14339:1877942273678720:192.168.202.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790945691.420981:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8582e7480 going to sleep for 11 seconds 00000100:00100000:3.0:1790945691.432720:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945691.432837:0:14315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254819840 00000100:00100000:2.0:1790945691.432848:0:14315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254819840 00000100:00100000:2.0:1790945691.432905:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:2.0:1790945691.432915:0:14315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+25:14464:x1877942254819840:12345-192.168.202.48@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790945691.433000:0:14315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+25:14464:x1877942254819840:12345-192.168.202.48@tcp:900:lhsmtool_posix.0 Request processed in 86us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945691.433008:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:1.0:1790945691.435417:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b374700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14339:1877942273678720:192.168.202.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790945691.436638:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.436753:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254819968 00000100:00100000:0.0:1790945691.436771:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254819968 00000100:00100000:0.0:1790945691.436829:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 39 00000100:00100000:0.0:1790945691.436840:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+24:14464:x1877942254819968:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790945691.436872:0:14305:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790945691.436981:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+24:14464:x1877942254819968:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 Request processed in 143us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945691.436990:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 39 00000100:00100000:0.0:1790945691.447586:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945691.448162:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254820096 00000100:00100000:1.0:1790945691.448173:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254820096 00000100:00100000:1.0:1790945691.448232:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 40 00000100:00100000:1.0:1790945691.448244:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+24:14464:x1877942254820096:12345-192.168.202.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790945691.448330:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b200/0xc5cf2c2a6a5507c7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448348:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b200/0xc5cf2c2a6a5507c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448376:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b200/0xc5cf2c2a6a5507c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448393:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a5507ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448401:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a5507ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448409:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a5507ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448433:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5507d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448441:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5507d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448447:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5507d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790945691.448484:0:14306:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790945691.448489:0:14306:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790945691.448503:0:14306:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5507d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448514:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b200/0xc5cf2c2a6a5507c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448521:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b200/0xc5cf2c2a6a5507c7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448539:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b200/0xc5cf2c2a6a5507c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448546:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167b200 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945691.448551:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b200/0xc5cf2c2a6a5507c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448559:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b200/0xc5cf2c2a6a5507c7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448572:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a200) 00010000:00010000:1.0:1790945691.448586:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945691.448592:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b200/0xc5cf2c2a6a5507c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448599:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b200/0xc5cf2c2a6a5507c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448612:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a5507ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448619:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a5507ce lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448626:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a5507ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448632:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167a600 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945691.448635:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a5507ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448650:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a5507ce lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448697:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9bb852834900) 00010000:00010000:1.0:1790945691.448700:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945691.448704:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a5507ce lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448710:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a5507ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448724:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5507d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448730:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5507d5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448736:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5507d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448741:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167b400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945691.448743:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5507d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448748:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5507d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448928:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:1.0:1790945691.448932:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790945691.448936:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5507d5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.448953:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a5507d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945691.449109:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+24:14464:x1877942254820096:12345-192.168.202.48@tcp:34:lhsmtool_posix.0 Request processed in 866us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945691.449118:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 40 00000100:00100000:1.0:1790945691.454995:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.455090:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254820352 00000100:00100000:0.0:1790945691.455101:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254820352 00000100:00100000:0.0:1790945691.455162:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 41 00000100:00100000:0.0:1790945691.455172:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+24:14464:x1877942254820352:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945691.455193:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945691.455214:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1dc00/0xc5cf2c2a6a5507dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8646 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.455351:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5507e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.455367:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5507e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.455377:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5507e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790945691.455389:0:14305:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790945691.455486:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5507e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.455494:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5507e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.455501:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5507e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.455508:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945691.455512:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5507e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.455520:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5507e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.455532:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:0.0:1790945691.455535:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790945691.455540:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5507e3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.455557:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a5507e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.455612:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1dc00/0xc5cf2c2a6a5507dc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8646 expref: 26 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.455622:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bb851c9a200) 00010000:00010000:0.0:1790945691.455624:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790945691.455628:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1dc00/0xc5cf2c2a6a5507dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8646 expref: 26 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.455637:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1dc00, rc 0) 00000100:00100000:0.0:1790945691.455735:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+25:14464:x1877942254820352:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 563us (749us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1790945691.455742:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 41 00000100:00100000:3.0:1790945691.460044:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.463905:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254820480 00000100:00100000:0.0:1790945691.463921:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254820480 00000100:00100000:0.0:1790945691.464045:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 42 00000100:00100000:0.0:1790945691.464057:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+25:14464:x1877942254820480:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790945691.464094:0:15011:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790945691.464228:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+25:14464:x1877942254820480:12345-192.168.202.48@tcp:53:lhsmtool_posix.0 Request processed in 173us (4193us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945691.464236:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 42 00000100:00100000:2.0:1790945691.468434:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945691.473379:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254820736 00000100:00100000:1.0:1790945691.473395:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254820736 00000100:00100000:3.0:1790945691.473480:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 43 00000100:00100000:3.0:1790945691.473494:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+25:14464:x1877942254820736:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945691.473517:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945691.473539:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d000/0xc5cf2c2a6a5507f1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c864d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790945691.474257:0:14305:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:3.0:1790945691.474265:0:14305:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1790945691.474331:0:14305:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1790945691.474604:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a5507f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.474620:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a5507f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.474643:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a5507f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.474728:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0d000/0xc5cf2c2a6a5507f1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c864d expref: 28 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.474749:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a5507f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c864d expref: 27 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.474759:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb851c9a500) 00010000:00010000:3.0:1790945691.474762:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790945691.474766:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865f0c200, rc 0) 00000100:00100000:3.0:1790945691.474846:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+27:14464:x1877942254820736:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 1354us (6422us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1790945691.474854:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 43 00000100:00100000:3.0:1790945691.481528:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.481628:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254820992 00000100:00100000:0.0:1790945691.481639:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254820992 00000100:00100000:0.0:1790945691.481730:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 44 00000100:00100000:0.0:1790945691.481755:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+27:14464:x1877942254820992:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790945691.481816:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945691.481842:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0c200/0xc5cf2c2a6a5507f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c864d expref: 27 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.481862:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb851c9a500) 00010000:00010000:0.0:1790945691.481874:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790945691.481895:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1dc00/0xc5cf2c2a6a550806 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.481908:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1dc00/0xc5cf2c2a6a550806 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.481917:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1dc00/0xc5cf2c2a6a550806 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.481929:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a55080d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa0a8476d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.481935:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a55080d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0a8476d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.481941:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a55080d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0a8476d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482000:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1dc00/0xc5cf2c2a6a550806 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482010:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1dc00/0xc5cf2c2a6a550806 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482030:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1dc00/0xc5cf2c2a6a550806 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482036:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1dc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945691.482041:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1dc00/0xc5cf2c2a6a550806 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482049:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1dc00/0xc5cf2c2a6a550806 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482058:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bb845042a00) 00010000:00010000:0.0:1790945691.482060:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945691.482064:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1dc00/0xc5cf2c2a6a550806 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482070:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1dc00/0xc5cf2c2a6a550806 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482080:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a55080d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0a8476d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482086:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a55080d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0a8476d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482092:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a55080d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0a8476d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482096:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945691.482099:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a55080d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0a8476d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482114:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a55080d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa0a8476d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482121:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa0a8476d (ffff9bb8510c8400) 00010000:00010000:0.0:1790945691.482123:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945691.482125:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a55080d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa0a8476d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.482131:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a55080d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa0a8476d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945691.482222:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+26:14464:x1877942254820992:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 469us (704us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790945691.482230:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 44 00000100:00100000:2.0:1790945691.486074:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945691.486170:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254821120 00000100:00100000:1.0:1790945691.486181:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254821120 00000100:00100000:1.0:1790945691.486243:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 45 00000100:00100000:1.0:1790945691.486253:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+26:14464:x1877942254821120:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790945691.486274:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790945691.486295:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550814 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8654 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.486331:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a55081b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.486345:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a55081b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.486356:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a55081b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.486458:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167b400/0xc5cf2c2a6a550814 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8654 expref: 28 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.486491:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a600/0xc5cf2c2a6a55081b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8654 expref: 27 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.486499:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb852834900) 00010000:00010000:1.0:1790945691.486503:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790945691.486506:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb84167a600, rc 0) 00000100:00100000:1.0:1790945691.486567:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+27:14464:x1877942254821120:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 316us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945691.486587:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 45 00000100:00100000:2.0:1790945691.490094:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.490189:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254821376 00000100:00100000:0.0:1790945691.490199:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254821376 00000100:00100000:0.0:1790945691.490259:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 46 00000100:00100000:0.0:1790945691.490269:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+27:14464:x1877942254821376:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790945691.490346:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550822 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.490364:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550822 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.490376:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550822 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790945691.490916:0:14305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1790945691.490928:0:14305:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437286270089ns, next at 438286267432ns, rc = 0 00000004:00010000:0.0:1790945691.491019:0:14305:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b9d8a140 reply state 0000000076e5afe3 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550822 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945691.491028:0:14305:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790945691.491118:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+29:14464:x1877942254821376:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 850us (1033us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1790945691.491125:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 46 00000100:00100000:0.0:1790945691.493763:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945691.495970:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254821504 00000100:00100000:2.0:1790945691.495985:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254821504 00000100:00100000:2.0:1790945691.496057:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 47 00000100:00100000:2.0:1790945691.496069:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+29:14464:x1877942254821504:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945691.496110:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945691.496132:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a550829 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c865b expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.496200:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a550829 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c865b expref: 30 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.496217:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a550829 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c865b expref: 30 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.496238:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb852834900) 00010000:00010000:2.0:1790945691.496242:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790945691.496245:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865430200, rc 0) 00000100:00100000:2.0:1790945691.496323:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+30:14464:x1877942254821504:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 255us (2573us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945691.496330:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 47 00010000:00010000:1.0:1790945691.497952:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550822 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.497967:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550822 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.497975:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550822 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.497982:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1cc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:1.0:1790945691.497987:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550822 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.497995:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550822 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.498011:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb852834900) 00010000:00010000:1.0:1790945691.498015:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790945691.498019:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550822 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.498042:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1cc00/0xc5cf2c2a6a550822 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945691.505474:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945691.505789:0:14990:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254821632 00000100:00100000:3.0:1790945691.505800:0:14990:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254821632 00000100:00100000:3.0:1790945691.505917:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:3.0:1790945691.505929:0:14990:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87acfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2370:x1877942254821632:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790945691.506330:0:14990:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87acfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:2370:x1877942254821632:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 Request processed in 402us (865us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790945691.506340:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00080000:0.0:1790945691.506883:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790945691.512012:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945691.512133:0:14307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254821888 00000100:00100000:2.0:1790945691.512144:0:14307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254821888 00000100:00100000:2.0:1790945691.512200:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:2.0:1790945691.512212:0:14307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+29:14464:x1877942254821888:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790945691.512635:0:14307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+30:14464:x1877942254821888:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 425us (635us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1790945691.512645:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:2.0:1790945691.516114:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.516227:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254822144 00000100:00100000:0.0:1790945691.516237:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254822144 00000100:00100000:0.0:1790945691.516342:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 48 00000100:00100000:0.0:1790945691.516354:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87516a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+30:14464:x1877942254822144:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790945691.516477:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87516a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+30:14464:x1877942254822144:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 125us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945691.516486:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 48 00000100:00100000:3.0:1790945691.527852:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945691.527961:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254822272 00000100:00100000:2.0:1790945691.527985:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254822272 00000100:00100000:2.0:1790945691.528048:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 49 00000100:00100000:2.0:1790945691.528059:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+30:14464:x1877942254822272:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790945691.528080:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790945691.528100:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a550830 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8662 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.528172:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a550837 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.528188:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a550837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.528200:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a550837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790945691.528239:0:14306:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790945691.528258:0:14306:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a550837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.528284:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430e00/0xc5cf2c2a6a550830 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8662 expref: 32 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.528303:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a550837 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8662 expref: 31 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.528312:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb852834900) 00010000:00010000:2.0:1790945691.528315:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790945691.528319:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865431200, rc 0) 00000100:00100000:2.0:1790945691.528385:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+31:14464:x1877942254822272:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 327us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945691.528399:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 49 00000100:00100000:2.0:1790945691.532108:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.532254:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254822400 00000100:00100000:0.0:1790945691.532264:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254822400 00000100:00100000:0.0:1790945691.532322:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:0.0:1790945691.532333:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb875169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+6:2372:x1877942254822400:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790945691.532351:0:14987:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790945691.532371:0:14987:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4b52a28/0xc5cf2c2a6a55083e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8669 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790945691.532401:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfa99b, blocks: 0x1 00010000:00010000:0.0:1790945691.532421:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1790945691.532440:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945691.532450:0:14987:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b52a28/0xc5cf2c2a6a55083e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8669 expref: 7 pid: 14987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.532473:0:14987:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4b52a28/0xc5cf2c2a6a55083e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8669 expref: 7 pid: 14987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.532488:0:14987:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865d1de00, rc 0) 00000100:00100000:0.0:1790945691.532852:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb875169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:2372:x1877942254822400:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 519us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945691.532861:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:0.0:1790945691.541913:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945691.542006:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254822656 00000100:00100000:1.0:1790945691.542017:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254822656 00000100:00100000:1.0:1790945691.542078:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 50 00000100:00100000:1.0:1790945691.542090:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+31:14464:x1877942254822656:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790945691.542214:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+31:14464:x1877942254822656:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 125us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1790945691.542222:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 50 00000100:00100000:2.0:1790945691.546052:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945691.546145:0:14306:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254822784 00000100:00100000:1.0:1790945691.546155:0:14306:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254822784 00000100:00100000:1.0:1790945691.546215:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 51 00000100:00100000:1.0:1790945691.546226:0:14306:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+31:14464:x1877942254822784:12345-192.168.202.48@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790945691.623685:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1790945691.623698:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1790945691.623719:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1790945691.623740:0:5846:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1790945691.623893:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273678848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790945691.623964:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945691.624045:0:14990:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273678848 00000100:00100000:1.0:1790945691.624053:0:14990:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273678848 00000100:00100000:1.0:1790945691.624112:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790945691.624122:0:14990:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273678848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1790945691.624290:0:14990:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790945691.624295:0:14990:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1790945691.624311:0:14990:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790945691.624313:0:14990:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790945691 -> 1790945691 00002000:00010000:1.0:1790945691.624316:0:14990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790945691.624361:0:14990:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1877942273678848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 240us (397us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1790945691.624369:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1790945691.624390:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1790945691.624418:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bb865f88380/2, rc 0, transno 8589934595 00000100:00100000:1.0:1790945691.624424:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273678848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790945691.624781:0:14306:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+14:14464:x1877942254822784:12345-192.168.202.48@tcp:44:lhsmtool_posix.0 Request processed in 78553us (78737us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945691.624790:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 51 00000100:00100000:2.0:1790945691.637020:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945691.638998:0:14989:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254822912 00000100:00100000:3.0:1790945691.639015:0:14989:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254822912 00000100:00100000:3.0:1790945691.639153:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:3.0:1790945691.639164:0:14989:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:2370:x1877942254822912:12345-192.168.202.48@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790945691.639304:0:14989:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:2370:x1877942254822912:12345-192.168.202.48@tcp:16:lhsmtool_posix.0 Request processed in 142us (2293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945691.639313:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:1.0:1790945691.644652:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945691.644778:0:15011:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254823168 00000100:00100000:2.0:1790945691.644788:0:15011:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254823168 00000100:00100000:2.0:1790945691.644845:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 52 00000100:00100000:2.0:1790945691.644856:0:15011:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+14:14464:x1877942254823168:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790945691.644925:0:15011:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945691.644952:0:15011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431200/0xc5cf2c2a6a550837 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8662 expref: 14 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.644973:0:15011:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb852834900) 00010000:00010000:2.0:1790945691.644979:0:15011:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790945691.645009:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550845 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.645025:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550845 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.645036:0:15011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550845 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790945691.645234:0:15011:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006ce3000b reply state 00000000df0ac1dd transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550845 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945691.645262:0:15011:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790945691.645368:0:15011:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+15:14464:x1877942254823168:12345-192.168.202.48@tcp:36:lhsmtool_posix.0 Request processed in 514us (725us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1790945691.645376:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 52 00010000:00010000:0.0:1790945691.648378:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550845 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.648394:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550845 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.648403:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550845 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.648409:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865431000 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945691.648427:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550845 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.648436:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550845 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.648451:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb852834900) 00010000:00010000:0.0:1790945691.648467:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945691.648473:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550845 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.648480:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865431000/0xc5cf2c2a6a550845 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15011 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945691.648826:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945691.649085:0:14990:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254823296 00000100:00100000:3.0:1790945691.649097:0:14990:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254823296 00000100:00100000:3.0:1790945691.649153:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:3.0:1790945691.649164:0:14990:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:14464:x1877942254823296:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790945691.649182:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790945691.649199:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a55084c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5a5ebfea88c8670 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.649226:0:14990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4b52a28/0xc5cf2c2a6a55083e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8669 expref: 8 pid: 14987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.649235:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945691.649239:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790945691.649245:0:14990:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a55084c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8670 expref: 8 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.649282:0:14990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4b52a28/0xc5cf2c2a6a55083e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8669 expref: 8 pid: 14987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.649297:0:14990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4b52a28/0xc5cf2c2a6a55083e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8669 expref: 8 pid: 14987 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945691.649327:0:14990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14990:1877942273678976:192.168.202.48@tcp:104: 00000100:00100000:3.0:1790945691.649434:0:14990:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1790945691.652139:0:14990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14990:1877942273678976:192.168.202.48@tcp:104: 00010000:00010000:3.0:1790945691.652180:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a55084c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8670 expref: 8 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.652201:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bb865f0d000, rc 0) 00000100:00100000:3.0:1790945691.652263:0:14990:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+8:14464:x1877942254823296:12345-192.168.202.48@tcp:101:lhsmtool_posix.0 Request processed in 3101us (3441us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945691.652272:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:2.0:1790945691.655236:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.655332:0:14291:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254823424 00000100:00100000:0.0:1790945691.655343:0:14291:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254823424 00010000:00010000:0.0:1790945691.655386:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b52a28/0xc5cf2c2a6a55083e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8669 expref: 8 pid: 14987 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945691.655569:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:0.0:1790945691.655589:0:14291:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873870000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+8:2372:x1877942254823424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790945691.655605:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790945691.655629:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4b52a28/0xc5cf2c2a6a55083e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8669 expref: 8 pid: 14987 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.655644:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4b52a28/0xc5cf2c2a6a55083e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8669 expref: 8 pid: 14987 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.655700:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4b52a28/0xc5cf2c2a6a55083e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8669 expref: 8 pid: 14987 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.655717:0:14291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945691.655721:0:14291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945691.655728:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a55084c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8670 expref: 7 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.655767:0:14291:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a55084c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8670 expref: 7 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.655817:0:14291:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a55084c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8670 expref: 7 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945691.655832:0:14291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14291:1877942273679104:192.168.202.48@tcp:105: 00000100:00100000:0.0:1790945691.655919:0:14291:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb851facc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945691.660063:0:14291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14291:1877942273679104:192.168.202.48@tcp:105: 00010000:00010000:0.0:1790945691.660090:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945691.660138:0:14291:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873870000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:2372:x1877942254823424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4551us (4912us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945691.660148:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:3.0:1790945691.664764:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.664903:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254823552 00000100:00100000:0.0:1790945691.664914:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254823552 00000100:00100000:0.0:1790945691.664975:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 17 00000100:00100000:0.0:1790945691.664985:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:2373:x1877942254823552:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790945691.665204:0:14987:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790945691.665208:0:14987:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790945691 00002000:00010000:0.0:1790945691.665211:0:14987:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790945690 00002000:00010000:0.0:1790945691.665213:0:14987:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790945691 -> 1790945691 00002000:00010000:0.0:1790945691.665215:0:14987:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790945691.665272:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+8:2373:x1877942254823552:12345-192.168.202.48@tcp:2:lhsmtool_posix.0 Request processed in 288us (529us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1790945691.665294:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 17 00000100:00100000:2.0:1790945691.678998:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945691.679557:0:16534:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254823680 00000100:00100000:1.0:1790945691.679568:0:16534:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254823680 00000100:00100000:1.0:1790945691.679726:0:16534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 18 00000100:00100000:1.0:1790945691.679737:0:16534:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+8:2373:x1877942254823680:12345-192.168.202.48@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790945691.679797:0:16534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.679819:0:16534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a55084c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8670 expref: 8 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.679829:0:16534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945691.679834:0:16534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790945691.679840:0:16534:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.679876:0:16534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a55084c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8670 expref: 8 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.679905:0:16534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a55084c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8670 expref: 8 pid: 14990 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945691.679923:0:16534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16534:1877942273679232:192.168.202.48@tcp:104: 00000100:00100000:1.0:1790945691.680016:0:16534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8430c8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790945691.693359:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945691.693450:0:14290:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254823808 00000100:00100000:3.0:1790945691.693461:0:14290:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254823808 00010000:00010000:3.0:1790945691.693501:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a55084c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8670 expref: 9 pid: 14990 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945691.693545:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:3.0:1790945691.693555:0:14290:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:2373:x1877942254823808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790945691.693581:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790945691.693605:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a55084c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8670 expref: 9 pid: 14990 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.693629:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a55084c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8670 expref: 9 pid: 14990 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.693707:0:14290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945691.693711:0:14290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790945691.693717:0:14290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.693728:0:14290:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.693748:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790945691.694167:0:14290:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:2373:x1877942254823808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 612us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945691.694178:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14 00010000:00010000:2.0:1790945691.695055:0:16534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df5ef727/0xc5cf2c2a6a55084c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c8670 expref: 8 pid: 14990 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945691.695076:0:16534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb865f89f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16534:1877942273679232:192.168.202.48@tcp:104: 00010000:00010000:2.0:1790945691.695100:0:16534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.695112:0:16534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.695120:0:16534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.695150:0:16534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.695159:0:16534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.695185:0:16534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.695193:0:16534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167be00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945691.695197:0:16534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.695207:0:16534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.695224:0:16534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.695233:0:16534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025187325/0xc5cf2c2a6a550853 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945691.695309:0:16534:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+7:2373:x1877942254823680:12345-192.168.202.48@tcp:1:lhsmtool_posix.0 Request processed in 15573us (16321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945691.695318:0:16534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 18 00000100:00100000:1.0:1790945691.698869:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945691.699017:0:14304:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254824064 00000100:00100000:3.0:1790945691.699029:0:14304:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254824064 00000100:00100000:3.0:1790945691.699086:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 53 00000100:00100000:3.0:1790945691.699097:0:14304:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+14:14464:x1877942254824064:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790945691.699178:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0dc00/0xc5cf2c2a6a55085a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.699199:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0dc00/0xc5cf2c2a6a55085a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.699212:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0dc00/0xc5cf2c2a6a55085a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.700003:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.700020:0:14304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a550829 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c865b expref: 15 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.700028:0:14304:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.700067:0:14304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a550829 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c865b expref: 15 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.700083:0:14304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a550829 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c865b expref: 15 pid: 14306 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945691.700098:0:14304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1877942273679360:192.168.202.48@tcp:104: 00000100:00100000:0.0:1790945691.700188:0:14304:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb851facc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790945691.703178:0:14304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1877942273679360:192.168.202.48@tcp:104: 00010000:00010000:0.0:1790945691.703210:0:14304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945691.708299:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945691.708410:0:16420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254824192 00000100:00100000:2.0:1790945691.708420:0:16420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254824192 00010000:00010000:2.0:1790945691.708460:0:16420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a550829 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c865b expref: 16 pid: 14306 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945691.708505:0:16420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:2.0:1790945691.708528:0:16420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+16:2372:x1877942254824192:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790945691.708545:0:16420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790945691.708552:0:16420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a550829 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c865b expref: 16 pid: 14306 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.708565:0:16420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a550829 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c865b expref: 16 pid: 14306 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.708598:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865430200/0xc5cf2c2a6a550829 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c865b expref: 16 pid: 14306 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.708622:0:16420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb852834900) 00010000:00010000:2.0:1790945691.708627:0:16420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.708636:0:16420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.708643:0:16420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945691.708712:0:16420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790945691.708767:0:16420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+15:2372:x1877942254824192:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 240us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945691.708774:0:16420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 15 00010000:00010000:3.0:1790945691.709169:0:14304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945691.709178:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790945691.709358:0:14304:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1790945691.709490:0:14304:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1790945691.709538:0:14304:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1790945691.709649:0:14304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb8716bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14304:1877942273679488:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790945691.709772:0:14304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945691.709797:0:14304:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb7435fbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790945691.710074:0:14309:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273679488 00000100:00100000:2.0:1790945691.710082:0:14309:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273679488 00000100:00100000:2.0:1790945691.710124:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790945691.710133:0:14309:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14304:x1877942273679488:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790945691.710215:0:14309:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14304:x1877942273679488:12345-0@lo:1000:mdt00_000.0 Request processed in 83us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945691.710223:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790945691.710312:0:14304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb8716bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14304:1877942273679488:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790945691.711003:0:14304:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1790945691.711069:0:14304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14304:1877942273679616:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790945691.711117:0:14304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945691.711138:0:14304:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb84553e000 going to sleep for 11 seconds 00000100:00100000:2.0:1790945691.711360:0:14309:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273679616 00000100:00100000:2.0:1790945691.711367:0:14309:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273679616 00000100:00100000:2.0:1790945691.711393:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790945691.711400:0:14309:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87b374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14304:x1877942273679616:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790945691.711541:0:14309:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87b374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14304:x1877942273679616:12345-0@lo:1000:mdt00_000.0 Request processed in 141us (423us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1790945691.711548:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790945691.714616:0:14304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb87b377800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14304:1877942273679616:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1790945691.714702:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.714713:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.714720:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.714726:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1de00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945691.714730:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.714738:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.714889:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb852834900) 00010000:00010000:0.0:1790945691.714894:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790945691.714899:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.714906:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1de00/0xc5cf2c2a6a550861 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.714940:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a5507b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.714947:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a5507b9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.714971:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a5507b9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.714977:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1c400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945691.714981:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a5507b9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.714989:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a5507b9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.714998:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:0.0:1790945691.715002:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790945691.715009:0:14304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a000/0xc5cf2c2a6a5507c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c863f expref: 18 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.715022:0:14304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a000/0xc5cf2c2a6a5507c0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c863f expref: 18 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.715034:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a000/0xc5cf2c2a6a5507c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c863f expref: 18 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.715098:0:14304:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167a000/0xc5cf2c2a6a5507c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0xd5a5ebfea88c863f expref: 18 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945691.715114:0:14304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb850a1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1877942273679744:192.168.202.48@tcp:105: 00000100:00100000:0.0:1790945691.715214:0:14304:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bb8582e7480 going to sleep for 11 seconds 00000100:00100000:0.0:1790945691.720853:0:14304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb850a1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1877942273679744:192.168.202.48@tcp:105: 00010000:00010000:0.0:1790945691.720902:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a5507b9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.720913:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1c400/0xc5cf2c2a6a5507b9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.720945:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550868 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.720960:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550868 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.720973:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550868 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.720984:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550868 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.720991:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550868 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.720998:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550868 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.721005:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d400 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945691.721009:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550868 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.721017:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550868 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.721029:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:0.0:1790945691.721038:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790945691.721044:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550868 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.721051:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865d1d400/0xc5cf2c2a6a550868 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.721062:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0dc00/0xc5cf2c2a6a55085a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.721068:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0dc00/0xc5cf2c2a6a55085a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.721075:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0dc00/0xc5cf2c2a6a55085a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.721081:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865f0dc00 already unused, calling callback (ffffffffc208b4f0) 00010000:00010000:0.0:1790945691.721084:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0dc00/0xc5cf2c2a6a55085a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.721091:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0dc00/0xc5cf2c2a6a55085a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.721099:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bb852834700) 00010000:00010000:0.0:1790945691.721102:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790945691.721105:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0dc00/0xc5cf2c2a6a55085a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.721111:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb865f0dc00/0xc5cf2c2a6a55085a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945691.721376:0:14304:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+18:14464:x1877942254824064:12345-192.168.202.48@tcp:57:lhsmtool_posix.0 Request processed in 22279us (22514us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1790945691.721397:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 53 00000020:00080000:0.0:1790945691.721403:0:14304:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790945691.721647:0:14339:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790945691.721652:0:14339:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790945691.721719:0:14339:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790945691.721726:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1790945691.725115:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945691.725280:0:14308:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254824448 00000100:00100000:1.0:1790945691.725291:0:14308:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254824448 00000100:00100000:1.0:1790945691.725360:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:1.0:1790945691.725372:0:14308:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8817f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+18:14464:x1877942254824448:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790945691.727084:0:14308:0:(mdd_object.c:4180:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790945691.727211:0:14308:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1790945691.727271:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55086f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.727289:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55086f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.727301:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55086f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.727310:0:14308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55086f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.727316:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55086f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.727331:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55086f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.727391:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790945691.727568:0:14308:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8817f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+20:14464:x1877942254824448:12345-192.168.202.48@tcp:35:lhsmtool_posix.0 Request processed in 2194us (2459us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1790945691.727588:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10 00000020:00080000:1.0:1790945691.727593:0:14308:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790945691.735293:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790945691.735312:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55086f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.735324:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167aa00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:0.0:1790945691.735328:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55086f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.735338:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55086f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.735358:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bb852834900) 00010000:00010000:0.0:1790945691.735362:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790945691.735366:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55086f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.735372:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bb84167aa00/0xc5cf2c2a6a55086f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.735395:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945691.735397:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790945691.735399:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790945691.736027:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945691.736242:0:14307:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254824576 00000100:00100000:2.0:1790945691.736255:0:14307:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254824576 00000100:00100000:2.0:1790945691.736314:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:2.0:1790945691.736325:0:14307:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+20:14462:x1877942254824576:12345-192.168.202.48@tcp:49:dd.0 00000100:00100000:2.0:1790945691.736492:0:14307:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+20:14462:x1877942254824576:12345-192.168.202.48@tcp:49:dd.0 Request processed in 168us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945691.736500:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11 00000100:00100000:3.0:1790945691.927709:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945691.927758:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945691.927895:0:14994:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254824704 00000100:00100000:1.0:1790945691.927908:0:14994:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254824704 00000100:00100000:1.0:1790945691.927970:0:14994:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254824832 00000100:00100000:1.0:1790945691.927973:0:14994:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254824832 00000100:00100000:1.0:1790945691.927992:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:1.0:1790945691.928001:0:14994:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+8:2370:x1877942254824704:12345-192.168.202.48@tcp:4:dd.0 00002000:00010000:1.0:1790945691.928050:0:14994:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6abfa99b, atime: 0x6abfa99a, ctime: 0x6abfa99b, blocks: 0x1 00010000:00010000:1.0:1790945691.928058:0:14994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550876 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.928075:0:14994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=437s v=(0 0) 00010000:00010000:1.0:1790945691.928079:0:14994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945691.928085:0:14994:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550876 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945691.928099:0:14994:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550876 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945691.934061:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945691.934364:0:14993:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1790945691.934374:0:14993:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1790945691.934783:0:14993:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254824960 00000100:00100000:1.0:1790945691.934805:0:14993:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254824960 00000100:00100000:0.0:1790945691.939558:0:16537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:0.0:1790945691.939589:0:16537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+10:2370:x1877942254824832:12345-192.168.202.48@tcp:4:dd.0 00010000:00010000:0.0:1790945691.939633:0:16537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a55087d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.939718:0:16537:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945691.939724:0:16537:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790945691.939730:0:16537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a55087d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790945691.939744:0:16537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a55087d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790945692.104702:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:0.0:1790945692.104719:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1790945692.104731:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1790945692.104737:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:1.0:1790945692.104772:0:14994:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1790945692.104778:0:14994:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1790945691 -> 1790945692 00002000:00010000:1.0:1790945692.104781:0:14994:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1790945692.104796:0:14994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550876 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.104809:0:14994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550876 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.104819:0:14994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550876 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.104826:0:14994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167a400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945692.104833:0:14994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550876 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.104842:0:14994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550876 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.104866:0:14994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550876 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.104873:0:14994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550876 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945692.104970:0:14994:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+10:2370:x1877942254824704:12345-192.168.202.48@tcp:4:dd.0 Request processed in 176965us (177267us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1790945692.104996:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:1.0:1790945692.105028:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:1.0:1790945692.105039:0:14994:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:2370:x1877942254824960:12345-192.168.202.48@tcp:4:dd.0 00010000:00010000:1.0:1790945692.105069:0:14994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a550884 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.105081:0:14994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945692.105085:0:14994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945692.105091:0:14994:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a550884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.105103:0:14994:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a550884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945692.128277:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790945692.162702:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1790945692.162820:0:16537:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1790945692.163214:0:16537:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1790945692.163230:0:16537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a55087d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.163244:0:16537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a55087d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.163253:0:16537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a55087d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.163260:0:16537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865d1d400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945692.163276:0:16537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a55087d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.163285:0:16537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a55087d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.163304:0:16537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a55087d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.163312:0:16537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000612d18db/0xc5cf2c2a6a55087d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945692.163411:0:16537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:2370:x1877942254824832:12345-192.168.202.48@tcp:4:dd.0 Request processed in 223834us (235648us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1790945692.163422:0:16537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1 00000001:00080000:0.0:1790945692.222401:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1790945692.222539:0:14994:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1790945692.222554:0:14994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a550884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.222576:0:14994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a550884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.222585:0:14994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a550884 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.222592:0:14994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167aa00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945692.222596:0:14994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a550884 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.222619:0:14994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a550884 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.222641:0:14994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a550884 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.222649:0:14994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a550884 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945692.222833:0:14994:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2370:x1877942254824960:12345-192.168.202.48@tcp:4:dd.0 Request processed in 117792us (288775us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790945692.222843:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:3.0:1790945692.241061:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945692.241242:0:14993:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254825088 00000100:00100000:1.0:1790945692.241253:0:14993:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254825088 00000100:00100000:1.0:1790945692.241331:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3 00000100:00100000:1.0:1790945692.241341:0:14993:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2371:x1877942254825088:12345-192.168.202.48@tcp:4:dd.0 00002000:00010000:1.0:1790945692.241393:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6abfa99c, atime: 0x6abfa99a, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1790945692.241403:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55088b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.241431:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1790945692.241435:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945692.241442:0:14993:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55088b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.241477:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55088b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945692.256512:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945692.256561:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1790945692.257187:0:16537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254825344 00000100:00100000:1.0:1790945692.257197:0:16537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254825344 00000100:00100000:1.0:1790945692.257269:0:16537:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254825600 00000100:00100000:1.0:1790945692.257273:0:16537:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254825600 00000100:00100000:1.0:1790945692.257300:0:16537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:1.0:1790945692.257312:0:16537:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+8:2371:x1877942254825344:12345-192.168.202.48@tcp:4:dd.0 00010000:00010000:1.0:1790945692.257347:0:16537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550892 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.257367:0:16537:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945692.257371:0:16537:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945692.257377:0:16537:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.257391:0:16537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790945692.259025:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945692.259239:0:14994:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1790945692.259247:0:14994:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1790945692.262140:0:14994:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254825216 00000100:00100000:2.0:1790945692.262154:0:14994:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254825216 00000100:00100000:0.0:1790945692.267410:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945692.267443:0:14994:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1790945692.267454:0:14994:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254825472 00000100:00100000:0.0:1790945692.267463:0:14994:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254825472 00000100:00100000:2.0:1790945692.271485:0:16540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:2.0:1790945692.271504:0:16540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb8716bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1d81a00-9000-4eda-ab02-47a5c184b1ba+13:2371:x1877942254825600:12345-192.168.202.48@tcp:4:dd.0 00010000:00010000:2.0:1790945692.271547:0:16540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000934bb673/0xc5cf2c2a6a550899 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.271576:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945692.271581:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945692.271588:0:16540:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000934bb673/0xc5cf2c2a6a550899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.271604:0:16540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000934bb673/0xc5cf2c2a6a550899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790945692.306549:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1790945692.306866:0:14993:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7654321 00002000:00010000:1.0:1790945692.306871:0:14993:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1790945692 00002000:00010000:1.0:1790945692.306874:0:14993:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1790945692.306889:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55088b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.306921:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55088b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.306931:0:14993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55088b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.306937:0:14993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167aa00 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:1.0:1790945692.306942:0:14993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55088b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.306951:0:14993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55088b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.306970:0:14993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55088b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.306990:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee60c123/0xc5cf2c2a6a55088b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790945692.307089:0:14993:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+15:2371:x1877942254825088:12345-192.168.202.48@tcp:4:dd.0 Request processed in 65744us (66031us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1790945692.307100:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3 00000100:00100000:1.0:1790945692.307135:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:1.0:1790945692.307148:0:14993:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb850a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+14:2370:x1877942254825216:12345-192.168.202.48@tcp:4:dd.0 00010000:00010000:1.0:1790945692.307182:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697e16f9/0xc5cf2c2a6a5508a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.307200:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945692.307205:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790945692.307212:0:14993:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000697e16f9/0xc5cf2c2a6a5508a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790945692.307225:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000697e16f9/0xc5cf2c2a6a5508a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790945692.353271:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:1.0:1790945692.353293:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:2.0:1790945692.354149:0:16540:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:2.0:1790945692.354169:0:16540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000934bb673/0xc5cf2c2a6a550899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.354183:0:16540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000934bb673/0xc5cf2c2a6a550899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.354192:0:16540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000934bb673/0xc5cf2c2a6a550899 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.354200:0:16540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865431800 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945692.354204:0:16540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000934bb673/0xc5cf2c2a6a550899 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.354229:0:16540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000934bb673/0xc5cf2c2a6a550899 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.354250:0:16540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000934bb673/0xc5cf2c2a6a550899 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.354259:0:16540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000934bb673/0xc5cf2c2a6a550899 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945692.354361:0:16540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1d81a00-9000-4eda-ab02-47a5c184b1ba+12:2371:x1877942254825600:12345-192.168.202.48@tcp:4:dd.0 Request processed in 82857us (97793us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1790945692.354372:0:16540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:2.0:1790945692.354403:0:16540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:2.0:1790945692.354416:0:16540:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb850a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1d81a00-9000-4eda-ab02-47a5c184b1ba+11:2370:x1877942254825472:12345-192.168.202.48@tcp:4:dd.0 00010000:00010000:2.0:1790945692.354445:0:16540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e1ca4e1/0xc5cf2c2a6a5508a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.354457:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945692.354461:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790945692.354468:0:16540:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e1ca4e1/0xc5cf2c2a6a5508a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.354479:0:16540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e1ca4e1/0xc5cf2c2a6a5508a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945692.355233:0:16537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945692.355245:0:16537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550892 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945692.355253:0:16537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550892 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945692.355259:0:16537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167a400 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:3.0:1790945692.355263:0:16537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550892 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945692.355270:0:16537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550892 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945692.355293:0:16537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550892 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790945692.355301:0:16537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004665413d/0xc5cf2c2a6a550892 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790945692.355349:0:16537:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb8716bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1d81a00-9000-4eda-ab02-47a5c184b1ba+11:2371:x1877942254825344:12345-192.168.202.48@tcp:4:dd.0 Request processed in 98039us (98844us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1790945692.355363:0:16537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4 00000001:00080000:2.0:1790945692.393321:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:2.0:1790945692.397008:0:14993:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:2.0:1790945692.397032:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697e16f9/0xc5cf2c2a6a5508a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.397046:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000697e16f9/0xc5cf2c2a6a5508a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.397055:0:14993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000697e16f9/0xc5cf2c2a6a5508a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.397062:0:14993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb84167b600 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945692.397067:0:14993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000697e16f9/0xc5cf2c2a6a5508a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.397076:0:14993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000697e16f9/0xc5cf2c2a6a5508a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.397098:0:14993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000697e16f9/0xc5cf2c2a6a5508a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.397106:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000697e16f9/0xc5cf2c2a6a5508a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945692.397206:0:14993:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb850a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+9:2370:x1877942254825216:12345-192.168.202.48@tcp:4:dd.0 Request processed in 90057us (138183us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790945692.397229:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6 00000001:00080000:0.0:1790945692.429196:0:7627:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:2.0:1790945692.429598:0:16540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e1ca4e1/0xc5cf2c2a6a5508a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.429610:0:16540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e1ca4e1/0xc5cf2c2a6a5508a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.429616:0:16540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e1ca4e1/0xc5cf2c2a6a5508a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.429621:0:16540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bb865431200 already unused, calling callback (ffffffffc164aac0) 00010000:00010000:2.0:1790945692.429625:0:16540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e1ca4e1/0xc5cf2c2a6a5508a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.429630:0:16540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e1ca4e1/0xc5cf2c2a6a5508a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.429645:0:16540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e1ca4e1/0xc5cf2c2a6a5508a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790945692.429650:0:16540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e1ca4e1/0xc5cf2c2a6a5508a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790945692.429755:0:16540:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb850a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2370:x1877942254825472:12345-192.168.202.48@tcp:4:dd.0 Request processed in 75341us (162351us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1790945692.429763:0:16540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7 00010000:00010000:0.0:1790945693.148134:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790945693.468047:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790945693.468079:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb873871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273679872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790945693.468148:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945693.468212:0:14991:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273679872 00000100:00100000:2.0:1790945693.468220:0:14991:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273679872 00000100:00100000:2.0:1790945693.468274:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790945693.468282:0:14991:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb873871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273679872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790945693.468315:0:14991:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790945693.468356:0:14991:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb873871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1877942273679872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945693.468364:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1790945693.468383:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790945693.468413:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb873871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1877942273679872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790945693.979858:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790945693.979882:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb850a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273680000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790945693.979952:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790945693.980019:0:14991:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273680000 00000100:00100000:0.0:1790945693.980027:0:14991:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273680000 00000100:00100000:0.0:1790945693.980081:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790945693.980092:0:14991:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb850a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273680000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790945693.980138:0:14991:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1790945693.980184:0:14991:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb850a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1877942273680000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790945693.980192:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1790945693.980214:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790945693.980241:0:3293:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1790945693.980247:0:3293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bb865f88380, transno 8589934595 00000004:00080000:0.0:1790945693.980258:0:3293:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1790945693.980284:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb850a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1877942273680000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790945693.981780:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb850a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ac65209-3704-434c-a055-442590f14168:3293:1877942273680128:0@lo:400:kworker.0 00000100:00100000:1.0:1790945693.981839:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790945693.981916:0:14297:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273680128 00000100:00100000:2.0:1790945693.981924:0:14297:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273680128 00000100:00100000:2.0:1790945693.981965:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790945693.981973:0:14297:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87380e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+19:3293:x1877942273680128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790945693.989323:0:14297:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87380e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ac65209-3704-434c-a055-442590f14168+19:3293:x1877942273680128:12345-0@lo:400:kworker.0 Request processed in 7340us (7472us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945693.989339:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790945693.989619:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb850a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ac65209-3704-434c-a055-442590f14168:3293:1877942273680128:0@lo:400:kworker.0 00000100:00100000:1.0:1790945693.989642:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790945693.989654:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb850a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273680512:0@lo:400:kworker.0 00000100:00100000:1.0:1790945693.989740:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945693.991559:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb850a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273680256:0@lo:400:kworker.0 00000100:00100000:1.0:1790945693.991625:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790945693.991691:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790945693.991699:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bb850a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273680384:0@lo:400:kworker.0 00000100:00100000:1.0:1790945693.991722:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790945693.992822:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273680512 00000100:00100000:3.0:1790945693.992833:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273680512 00000100:00100000:3.0:1790945693.992906:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273680256 00000100:00100000:3.0:1790945693.992909:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273680256 00000100:00100000:3.0:1790945693.992922:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942273680384 00000100:00100000:3.0:1790945693.992925:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942273680384 00000100:00100000:3.0:1790945693.992944:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790945693.992953:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273680512:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790945693.992967:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790945693.993036:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1877942273680512:12345-0@lo:400:kworker.0 Request processed in 83us (3295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945693.993043:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790945693.993062:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945693.993068:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273680256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945693.993105:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1877942273680256:12345-0@lo:400:kworker.0 Request processed in 36us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945693.993112:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790945693.993137:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790945693.993143:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb865f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273680384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790945693.993174:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb865f8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1877942273680384:12345-0@lo:400:kworker.0 Request processed in 31us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945693.993180:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790945693.993212:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb850a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1877942273680384:0@lo:400:kworker.0 00000100:00100000:1.0:1790945693.993212:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb850a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1877942273680512:0@lo:400:kworker.0 00000100:00100000:3.0:1790945693.993232:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bb850a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1877942273680256:0@lo:400:kworker.0 00010000:00010000:2.0:1790945694.184210:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790945694.344589:0:16578:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1790945694.356840:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1790945694.356940:0:14299:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254825728 00000100:00100000:3.0:1790945694.356951:0:14299:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254825728 00000100:00100000:3.0:1790945694.357020:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 123 00000100:00100000:3.0:1790945694.357031:0:14299:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb87380c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+13:2373:x1877942254825728:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945694.357103:0:14299:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb87380c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0498e5a3-7601-4041-84f4-4c7941c69f16+13:2373:x1877942254825728:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945694.357111:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 123 00000100:00100000:0.0:1790945694.357853:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945694.357885:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945694.357911:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945694.357927:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945694.357942:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1790945694.357960:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1790945694.358030:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254825984 00000100:00100000:2.0:1790945694.358037:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254825984 00000100:00100000:2.0:1790945694.358081:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254826112 00000100:00100000:2.0:1790945694.358085:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254826112 00000100:00100000:2.0:1790945694.358099:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254826368 00000100:00100000:2.0:1790945694.358101:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254826368 00000100:00100000:2.0:1790945694.358112:0:14987:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254826496 00000100:00100000:2.0:1790945694.358126:0:14987:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254826496 00000100:00100000:2.0:1790945694.358145:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:2.0:1790945694.358152:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb850a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2372:x1877942254825984:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945694.358200:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb850a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2372:x1877942254825984:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 48us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945694.358208:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:2.0:1790945694.358223:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:2.0:1790945694.358229:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb850a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2372:x1877942254826112:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945694.358254:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb850a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1d81a00-9000-4eda-ab02-47a5c184b1ba+5:2372:x1877942254826112:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945694.358260:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:2.0:1790945694.358273:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:2.0:1790945694.358279:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb850a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+5:2372:x1877942254826368:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945694.358300:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb850a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+5:2372:x1877942254826368:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 22us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945694.358306:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:2.0:1790945694.358316:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00100000:2.0:1790945694.358323:0:14987:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb850a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+5:2372:x1877942254826496:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1790945694.358344:0:14987:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb850a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76100aa7-c8ca-49bd-af68-2804246b11f7+5:2372:x1877942254826496:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 22us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790945694.358350:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 16 00000100:00080000:0.0:1790945694.358497:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790945694.358501:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790945694.358764:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254825856 00000100:00100000:3.0:1790945694.358769:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254825856 00000100:00100000:3.0:1790945694.358810:0:14305:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877942254826240 00000100:00100000:3.0:1790945694.358813:0:14305:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877942254826240 00000100:00100000:3.0:1790945694.358833:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 29 00000100:00100000:3.0:1790945694.358839:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb850a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+20:2373:x1877942254825856:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945694.358879:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb850a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1d81a00-9000-4eda-ab02-47a5c184b1ba+20:2373:x1877942254825856:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 40us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945694.358886:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 29 00000100:00100000:3.0:1790945694.358898:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 30 00000100:00100000:3.0:1790945694.358904:0:14305:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9bb850a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+6:2372:x1877942254826240:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1790945694.358937:0:14305:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9bb850a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76100aa7-c8ca-49bd-af68-2804246b11f7+6:2372:x1877942254826240:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 33us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1790945694.358944:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 30 00000100:00080000:0.0:1790945694.359156:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1790945694.812149:0:14339:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790945694.812159:0:14339:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790945694.812190:0:14339:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790945694.812196:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1790945695.196787:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29303 lines, 29303 kept, 0 dropped, 0 bad.